WebQuest Research Chat Transcript
November 12, 2003
# Tappedin transcript for BernieD, 2003.11.12 17:21:06
# BernieD contributed 96 messages, 4 emotes, 3 private messages, and 0 private emotes
during 85 minutes.
2003.11.12 15:55:32 Login
Room: BernieD_Ofc
BernieD joined the room.
BernieD left the room.
Room: ASO
BernieD joined the room.
BJ waves hi to all the new arrivals
BethD joined the room.
BJ: Hi, Bernie!
BernieD: Hi all!
MargueritV: Good evening Bernie
LeticiaC: hello all!
FernandaR: hi!
MaryFT joined the room.
LeticiaC: howdy mary!
BJ: We still have a couple minutes, Bernie. I'll announce and then we can get the
ball rolling, ok?
BernieD: OK
KeithGst1: Good evening!
TomMarch joined the room.
KoreenG joined the room.
BernieD: Hey Tom
BJ: If you are new to participating in Tapped In discussions, please read the 10 steps
above this chat window
JimGst12 left the room.
TomMarch left the room (signed off).
JimGst12 joined the room.
BjB: |** ANNOUNCEMENT: WebQuests with Bernie Dodge is starting shortly in the After
School Online room. The topic is Research on Webquests. To participate, click on the
ONLINE tab to the left of your chat window, single click on BernieD and then click
on the door icon at the bottom. **|
BJ: If you see this, you're already in the right place :-)
HelenS joined the room.
AmandaD joined the room.
TomMarch joined the room.
BernieD waves at new arrivals
HelenS: waving back!
BJ: Welcome, everyone, to tonight's WebQuest discussion with Bernie Dodge.
BernieD: Very international group tonight
BJ: A reminder that you can click on Actions in the top right of your screen and scroll
down to DETACH to make your chat window larger and easier to read
HelenS: really? how can you tell?
MarkAH joined the room.
BJ: when Bernie shows a url, it will be hyperlinked. Click on the blue link to open
a new window
BJ: We usually start the discussions with introductions...so Helen can see the international
participants ;-)
HelenS: lol
BJ: I'm a teacher in Pennsylvania and a helpdesk volunteer for Tapped In
BernieD: I'm Bernie Dodge, a professor at San Diego State University.
LeticiaC: I'm a pre-service teacher at the University of Houston
HelenS: I'm a student teacher in Houston - elementary level
AprilB: I am April Brown, a preservice teacher in Ohio.
JimHi: Science teacher middle school in Edgewood Kentucky
FernandaR: I'm an EFL teacher in Portugal
AmandaD: I'm a student at University of Western Ontario hoping to enter pre-service
program next year
MaryFT: I'm Mary Thompson and I teach preservice teacher technology courses at the
University of Houston
MarkAH: I'm a teacher educator at the University of Oregon
KeithGst1: I'm Keith Connor, an ESOL teacher in Georgia.
KristinaR: I'm an English teacher and technology coordinator at Woodland H.S., Woodland,
California
IsabelP: I'm a teacher in south of Spain and also working on my PhD
JimGst12: I'm Jim, a student teacher from Western Australia.
JeanneP: I'm Jeannie Pascon. I teach middle school students in CT how to write WebQuests
(and Bernie, you told me it couldn't be done...) to teach them Information Technology
Literacy.
HelenS: (wow!)
KoreenG: I'm Koreen a computer teacher in California and grad student at Sac State
BernieD: 5 more
BJ is glad Bernie is keeping track!
BethD: Media Specialist at a middle school in Michigan
TomMarch: I'm not sure what I do, but it's in beautiful Australia and I
TomMarch: 'm ahppy to be here (and too quick on the enter key)
BernieD welcomes Tom especially
HelenS: haha
TimLa joined the room.
AmandaD: I regret that I can not participate in the discussion tonight, I have class
at 8, but am doing a research project about Webquests and am interested in your discussion
BJ: hi, Tim...just in time for intro's
TimLa: oh thanks
BJ . o O ( and then I think you can start, Bernie. )
DelfinoG joined the room.
MargueritV: I'm an instructor of Ed Tech at Wright State University in Ohio
BJ: Delfino, welcome. Please quickly introduce yourself.
JeffC joined the room.
LeticiaC: delfino...we're waiting
BJ: Hi, Jeff...want to quickly introduce yourself. Then Bernie is going to start
DelfinoG: Hi, Lety. Is it you?
LeticiaC: lol...yup
LeticiaC: welcome!
CarolynHK joined the room.
RhondaDC joined the room.
DelfinoG: Hey, I guess I'm in the right place, right?
LeticiaC: this is webquests!
BernieD: OK.... welcome everyone. Three continents represented! Ordinarily in these
monthly sessions, we look at a number of WebQuests and analyze some particular aspect
of them. Tonight will be a bit different.
BernieD: With such a large group, I think we're going to have to institute a little
protocol for interaction.
CarolynHK left the room.
DelfinoG: I've just entered and wonder if this where I'm suppose to chat for the professional
stuff for the tech. class.
BernieD: If you have a question at any point, please just type a ? and wait to be recognized.
If you have a comment, type a !.
BernieD: Yes, Delfino, this is the right place.
AmandaN joined the room.
BernieD: Tonight's session is about research about WebQuests. What's out there? Who's
doing research? What are the challenges involved in doing research on WebQuests.
CarolynHK joined the room.
BernieD: I get email every week or two from grad students interested in doing a thesis
or dissertation on this topic. One thing they often report is that their committee
is reluctant to let them go ahead with a study because there's not much literature
about WebQuests.... which seems like a self-fulfilling prophecy that guarantees that
there will never be a research literature about WebQuests!
DelfinoG: Okay, since I have that straight. What are we suppose to talk about?
LeticiaC: i think the most obvious is the challenge of having the technology available
BernieD: BJ... could you talk to Delfino privately?
BernieD: Well, that's not really a research issue. What happens when the technology
IS there?
LeticiaC: oh i'm sorry...
BernieD: My response to that kind of statement is to remind everyone that the WebQuest
model didn't fall out the sky from the planet Krypton. It's just a particular packaging
of concepts and techniques like cooperative learning, advanced organizers, scaffolding,
problem-based learning, and so on...each of which has a huge literature base. So when
it comes time to do a lit review in preparation for a WebQuest study, you construct
it based on whatever aspects of WebQuests that you're interested in.
JuanGst18 joined the room.
AmandaN left the room (signed off).
BernieD: So what kinds of studies might one try to do about WebQuests? One obvious
type might be to do a quasi-experimental study in which you compare one group who learned
something via a WebQuest vs another group that didn't. That helps answer the question
as to whether WebQuests are better than traditional instruction. It's a practical kind
of question that working teachers or principals are interested in.
SusanR joined the room.
AldenT joined the room.
BernieD: The problem in such studies is coming up with what the non-WebQuest looks
like. Does it take the same amount of class time? Does it have the same amount of interaction
among learners? Does it use the same information as the web provides? Once you start
to define the "traditional" instruction that you're comparing a WebQuest
to, you realize that this is a fairly rich experience with lots of facets, any one
of which could account for much of the difference in effectiveness.
BernieD: So a downside of a comparison study like that, though, is that it doesn't
add to our knowledge of how WebQuests work and what parts of the model are most important.
LeticiaC: I do like that method for reseraching Webquests because we need to know how
our students are learning
BernieD: So the question is... how do you go about doing that.
BernieD: This would be a good time to
JodiM joined the room.
BernieD: scan the room and see who has actually done some research in this area. Has
anyone designed a research study about WebQuests?
HelenS: ?
BernieD: Go Helen
HelenS: are you refering to graduate level study? or are you asking if we have made
a webquest?
BernieD: I'm asking about actual research on a WebQuest that's already been developed.
BernieD: Well.... looks like this room reflects the actual world.
HelenS: AH.... I don't think I'm doign that
AldenT: Just getting started my 570 class
BernieD: There aren't that many studies that have been done although there's one that
will start to collect data next Monday.
IsabelP: a!
JimHi left the room.
BernieD: The researcher for that study will be arriving here at some point, and I'll
introduce him when he comes.
KoreenG: We have starting collecting data on a research project we are doing with webquests
BernieD: Really!!! Tell us more!
KoreenG: Our area of focus is...
KoreenG: to describe the impact of teaching with problem-based strategies, specifically
using WebQuests, and its impact on students? problem-solving skills particularly in
the area of reading comprehension.
BernieD: Cool. What's the task in the WebQuest?
KristinaR: !
BernieD: Go Kristina
KoreenG: We are in the process of revising from one webquest to another
ChristinLW joined the room.
BernieD: You mean modifying an existing one?
KristinaR: Koreen and I are in the iMET program at Sac state and will be using the
reading comprehension or grammar webquest designed to discover the impact on problem
solving skills with students in grades 8th and 10th
MaryFT left the room.
HelenS left the room.
JodiM: Do you know how you will assess the impact of using the webquest?
KoreenG: We are shifting from a reading comprehension webquest to a grammar webquest
LeticiaC left the room.
BernieD: Grammar isn't something I would think of as a WebQuest task. What are the
kids doing exactly?
KristinaR: we are talking about using a standards based pretest, quality of product
and post test
RhondaDC left the room.
TimLa: ?
KristinaR: Koreen can you project the URL?
KoreenG: sure...
KoreenG: http://imet.csus.edu/imet5/koreen/imetsites/282
BernieD: So... everyone click on the blue line
BJ checks to see if everyone got the webpage
KoreenG: This is the teacher tools website. The webquest itself is one of the links
on the site
BernieD: "Welcome to the exciting world of teaching grammar." Nothing like
a bit of humor to kick it off!
JimGst12 left the room (signed off).
KristinaR: the webquest link explains directions for the students
JuliaGst6 joined the room.
RhondaDC joined the room.
RhondaDC left the room.
BethD left the room (signed off).
GaindaS joined the room.
TimLa: ?
BernieD: So... I guess there's some judgment required to choose which 10 grammar rules
to pick, and some creative design needed to make the lesson plans. is that the idea?
BernieD: Go Tim
KoreenG: Yes
KristinaR: yes
AmyD: !
KristinaR: But please note that this is not finished
TomMarch: !
BernieD: After Tim, Amy is next.
TimLa: Couldn't a teacher just as easily do this webquest as a project in which students
must teach the class without it being in the form of a wbequest?
TimLa: webquest
DelfinoG left the room (signed off).
TimLa left the room (signed off).
BernieD: Well he left. No need to answer that. :-)
BernieD: Amy had a comment, then Tom.
AmyD: Last semester in one of my classes we created a webquest similar to this for
one of our projects. We had to pick a grade and subject to teach. The kids loved it
and it really made them use their critical thinking skills.
KristinaR: yes if the teacher wanted to scaffold the lesson, but students will be using
the references on their own
BernieD: Go Tom
TomMarch: One of the questions I always ask when assessing WQ's is, "Could students
do the task without instruction?" Seems so in this case. Bernie makes a good case
for a central, organizing task.
KeithGst1 left the room (signed off).
KeithGst20 joined the room.
IsabelP left the room (signed off).
TimLa joined the room.
KoreenG: What is the good case for the central, organizing task?
TomMarch: Am I putting words in your mouth?
JuanGst18 left the room (signed off).
AmyD: ?
BernieD: I think Tom is referring to my favoring a big meaty task rather than a sequence
of smaller tasks in series.
TomMarch: yup
TimLa left the room (signed off).
TomMarch: Also, not "discovering" found knowledge, but venturing into ill-structured
domains.
CarolynHK: ?
AmyD: What is the youngest age group that can successfully do a webquest?
BernieD: But maybe this is two fairly meaty tasks, so I'm not unhappy with it. Depends
on how hard it is to come up with the 10 most important grammar rules.
KoreenG: After attending the CUE conference and presentation on WebQuests I was worried
that our webquest didn't meet the criteria
BernieD: I usually say 3rd grade, Amy, though there are some good ones that go lower.
TimLa joined the room.
BernieD: Whose presentation was that, K?
JodiM: Do you know if webquests are used in higher education?
BernieD: All the time, Jodi.
AprilB: !
GaindaS left the room.
BernieD: Carolyn has a question.
KoreenG: I don't remember his last name, but his first was Phillip
JimCGst21 joined the room.
JodiM: Do you know of any example webquests for higher education?
AprilB: !
BernieD: Ah. Philip Molebash. The guy in Tom March's old office across the hall.
CarolynHK: If we are still interested in research and Webquests, I'm wondering what
kind of activity would one compare this webquest with....one that is basically the
same activity, but off line?
FernandaR: I have to go, sorry...
JamesPF joined the room.
BernieD: Yes... that's the rub, Carolyn.
BernieD: In general I would like to see case studies or other qualitative research
that looks closely at a WebQuest class and tries to tease out what's going on there.
I personally think that studies that compare two different variations on a WebQuest
rather than WebQuest vs. non-WebQuest are likely to be more fruitful.
BernieD: (as opposed to a comparison study)
FernandaR left the room (signed off).
TimLa: !
BernieD: And fortuitously, my favorite WebQuest researcher just entered the room.
GaindaS joined the room.
JamesPF: Hi All,
BernieD: James Frazee is conducting a study using a WebQuest with college kids.
AprilB: !
BernieD: Why don't you tell us about it, James?
JamesPF: The purpose of this exploratory and descriptive case study is to advance our
understanding of the effective use of the WebQuest model.
JamesPF: The study represents a plan for investigating the effectiveness of one particular
element of the WebQuest model - the jigsaw cooperative grouping method.
JamesPF: The study will examine two variations of the WebQuest model, one with and
one without the addition of the jigsaw method, in order to provide a comparison of
the effect of the WebQuest model of instruction on students? personal agency beliefs,
engagement, and learning in a WebQuest problem-solving task.
JamesPF: if this seems like a cut and paste - it is - right from the abstract (forgive
me)
BernieD: Can you show us the actual WebQuest?
JamesPF: Specifically, this study will examine the practices of students from two undergraduate
history classes tasked with completing an AIDS-related WebQuest project.
JamesPF: http://www.rohan.sdsu.edu/~fnobilet/courses/hist406/index.htm
JamesPF: curious to get feedback and to hear about other research going on.
Jan_NS joined the room.
RamonaGst22 joined the room.
BernieD: Your arrival doubled the number of studies in the room, James.
BernieD waves to Jan and Ramona
TimLa: ?
JamesPF: Came straight from gathering some data - sorry for the delay
BernieD: Tim has a longstanding question.
Jan_NS left the room (signed off).
BernieD waves goodbye to Jan's shadow
TimLa: What type of data are you gathering from your study James or in other words
what is the assessment?
Jan_NS joined the room.
JamesPF: There are three main "dependent measures"
JamesPF: They are students' personal agency beliefs, engagement and learning
JamesPF: The first research Q is:
JamesPF: sWill exposure to a role-specific Jigsaw activity (integrated into a team-based
WebQuest focused on "Living with AIDS") produce a significantly greater increase
in students? personal agency beliefs than exposure to the same WebQuest without a role-specific
Jigsaw activity?
RamonaGst22 left the room.
JamesPF: Not sure where all the questions marks are coming from (carriage returns ,
I guess), the 2nd Q is:
JamesPF: How is the learning process different for students exposed to a role-specific
Jigsaw activity (integrated into a team-based WebQuest focused on "living with
AIDS") as compared to students exposed to the same WebQuest without a role-specific
Jigsaw activity?
KeithGst20: ?
JamesPF: And, more specifically: Do students exposed to a role-specific Jigsaw activity
(integrated into a team-based WebQuest focused on "living with AIDS") report
more time on task (i.e., in-class and outside of class in terms of individual time
and group time) than students exposed to the same WebQuest without a role-specific
Jigsaw activity?
TimLa: pardon my ignorance but what is a role specific jigsaw activity?
JamesPF: Sorry..
JamesPF: It is is a WQ with a jigsaw activity
TimLa: I still don't understand what a jigsaw activity is
BernieD: http://www.jigsaw.org
TimLa: Thanks
JamesPF: Both classes get the identical WQ, but one has more interconnectedness/interdependenc
BernieD: April has a comment, then Keith
JamesPF: Educational approach where the work of a group is divided into pieces (e.g.,
role-specific tasks) and each member of the group learns their piece and then through
the process of solving their piece of the puzzle teaches what they learned back to
their fellow group members.
AprilB: I was just going to say something about WebQuest at the colllege level
TimLa: I understand now thank you.
RamonaGst22 joined the room.
BJ left the room.
AprilB: I just did one this semester for the first time (I am undergrad). It was very
helpful and a positive learning experience.
BJ joined the room.
JuliaGst6 left the room (signed off).
JodiM: In what subject April?
JimCGst21: ?
BernieD: You mean you experienced it as a student?
AprilB: It was for poetry...yes I mean I experienced it as a student
TomMarch: !
JamesPF: While the model is very well received by teachers and students alike, there
is very little in the way of empirical research on the elements that make an effective
WebQuest, and most evidence of its effectiveness is anecdotal.
BernieD: Cool. Go Keith
KeithGst20: Is data being gathered about the political and social beliefs about the
students participating due to the topic (AIDS)? This topic may play a part in the diagnosis
of your data.
AmyD: So with this webquest each student has an individual part he/she is responsible
for then reports it to the group to make the concept complete
JamesPF: There are more research Qs than I have shared, but - Yes, Keith
AmandaN joined the room.
BernieD: Jim is next, then TOm
JimCGst21: I would like to contribute to research.
FionaGst26 joined the room.
BernieD: Send James a check!
JeanneP: !
RamonaGst22 left the room.
JimCGst21: My proposal is to be submitted in a couple of weeks. focus - higher order
thinking and how WQ promote this
BernieD: Really! Where are you studying?
RamonaGst22 joined the room.
RamonaGst22 left the room (signed off).
RamonaGst22 joined the room.
JimCGst21: Any suggestions on what else I may be able to research? My proposal is not
concrete yet. Curtin Universtity, Western Australia. Met Tom a couple of months ago.
JamesPF: Keith, really it is more about their "sensitivity" or appreciation
of multiple viewpoints/perspectives - not just their tolerance -rather appreciation
of what it might be like to be "living with AIDS"
RamonaGst22: Can someone tell me if I am in the Webquest tapped in room?
AprilB: yes
BernieD: That's a long conversation, Jim. We should talk later.
JamesPF: Uncertainty is an area ripe for research
BernieD: Tom has a comment, then Jeanne and then we have to stop. Go Tom
KeithGst20: I understand, but I just wanted to be constructive with my thoughts to
help promote your research.
ReneF joined the room.
TomMarch: I wonder what information you are gathering on participants. The reason I
ask is that I see using the jigsaw as one of the sacffolds that can be varied according
to user's expertise. Is there a pre-test that can identify how "expert" someone
might be in problem-solving and then see if the jigsaw scaffold was helpful to them?
Do you see what I'm getting at?
RamonaGst22: This is all new to me ~ do I just wait here until something begins? I'm
doing this for a graduate course.
KeithGst20: !
BettyhoGst27 joined the room.
JodiM left the room (signed off).
MarkAH: ?
PeterJS joined the room.
RiannH joined the room.
BernieD: (We have to vacate the room in 3 minutes, so I'm going to have to put a hold
on new questions)
KeithGst20: Maybe logic problems, or a MENSA test, or brain teasers could be used for
problem-solving tests.
JamesPF: Tom - Yes, I think I do understand what you are getting at. Unfortunately,
I am working with two intact classes and am not collecting some of the data that you
suggest.
JeanneP: I can hardly call this "empirical data," but...
JeanneP: When I first started teaching my 8th graders, I had a bunch of lessons teaching
the information literacy skills (searching, evaluating websites, copyright, higher-order
thinking, Big6 Skills, etc.) Then we went into the creation of the WQ by the students
in groups. About 2/3 of the way through the year I realized that it should be a WQ
itself! With the obvious task being to create a WQ.
BJ left the room.
RiannH left the room.
BernieD: The problem they're grappling with in James's study will be equally new to
all of them, I think.
AldenT: Ramona, I think this discussion is ending you may want to go to the next ASO
at later on today.
BJ joined the room.
BernieD: Good thought, Jeanne.
RamonaGst22: Thanks ~
JeanneP: I do survey the students as they exit my Info Tech Lit class to see what they
think they will continue to use in their everyday lives and for school research purposes.
From their comments and my observations, I feel that they are taking much more of the
ITL skills with them now that is organized into a WQ.
BernieD: OK... all, before BJ evicts us, we need to begin to end this session.
BernieD: I have one last URL to share with anyone thinking about doing research.
TomMarch: What I'm thinking is that scaffolding (jigsaws) may not be useful to adult
learners, whereas it could be crucial to middle schoolers. Another study?
BJ blushes...didn't think I was being that obvious, Bernie.
JamesPF: Tom, will contact you after this for some more conversation.
BernieD: I use it all the time with grad students and I think it works (though I haven't
collected data to prove that!)
BernieD: http://webquest.org/webquest-bibliography.htm
PeterJS left the room.
SusanR left the room (signed off).
BernieD: This is a biblography I'm starting to collect. Most of the items are not research
studies, but they might play a role in beefing up ones lit review.
AmyD: Thank you for your time. I really enjoyed learning about these webquests
ChristinLW left the room.
KeithGst20 left the room (signed off).
BernieD: And with that, i have to thank you all for coming. If you'd like to continue
the discsussion for awhile, follow me to my office.
KoreenG: Yes, thank you for the feedback!
AprilB: Thank you Bernie, James, everyone.
AmyD left the room (signed off).
JamesPF: Thank you, sorry I couldn't get here earlier
JeanneP: It was great to hear from others using and researching WQ! Ciao!
AldenT: waves goodbye See ya!
JimCGst21: Thanks Everyone!
BJ: The Social Studies Forum follows this discussion in this room
BJ: You are all welcome to stay and participate
BernieD left the room.
Next.... in Bernie's Office
Room: BernieD_Ofc
BernieD joined the room.
JeanneP joined the room.
Jan_NS joined the room.
MarkAH joined the room.
BernieD: Hygiene. Hi Jan.
BernieD: Welcome Mark
TomMarch joined the room.
BernieD: Hi Tom.
MarkAH: Hi Bernie...
Jan_NS: Hi, Bernie - no more "Smoke gets in your eyes"?
JeanneP: Very cute... I have not heard that one in awhile :-)
BernieD: Less crowded for sure.
MarkAH: .... I have some information to share regarding research designs. May I post
it on your whiteboard?
JamesPF joined the room.
TomMarch: Hi Bernie. The study sounds great. Comparing WebQuests as opposed to a non-WebQuest
seems a good way to go.
JimCGst21 joined the room.
BernieD: Dontcha love it when someone assigns their students to show up in Tapped In
without prepping them at all?
CarolynHK joined the room.
KristinaR joined the room.
JamesPF: This is great, just wish I got in at the start
BernieD: Welcome all! I should have stopped at Costco to get some mini-quiches.
CarolynHK: mark had a question before we came in here
TimLa joined the room.
BernieD: Leave your punctuation marks at the door.
BernieD: OK... to continue the discussion.... James is shoulder deep in this right
now. Any questions for him?
MarkAH: James, I noticed your research questions did speak to any specific learning
outcomes. Can you comment on this?
JamesPF: Didnt get to the most important Q 3
JamesPF: Will student performance on an HIV/AIDS Semantic Relationship Test and HIV/AIDS
Relationship Judgment test, as well as writing in response to a final (essay) test
question exhibit greater depth of understanding concerning ?living with AIDS? for those
students exposed to a role-specific Jigsaw activity (integrated into a team-based WebQuest
focused on "living with AIDS") than for students exposed to the same WebQuest
without a role-specific Jigsaw activity?
TimLa left the room (signed off).
JamesPF: ignore the ? marks they're supposed to be quotes
JamesPF: Am using "structural Knowledge" to examine the impact on the cognitive
domain
MarkAH: I see. thanks
JamesPF: See Jonassen 93
KristinaR: James will you be giving the students a rubric for the essay question before
hand or do your students already know your expectations for depth of understanding?
JamesPF: We have a rubric, but we are also using an expert rating/scoring guide that
looks at possible assertions that they might make
CarolynHK: so you're wondering about the efficacy of the role-specific jigsaw activity...versus....the
webquest without the jigsaw component
KristinaR: thanks that clarifies
BernieD: James did a great job of picking the brains of AIDS experts to develop a scoring
sheet
JamesPF: The essay Q has to do with how they would choose to spend $ to fight the spread
of AIDS
BernieD: You were just collecting data just before the chat. What was that about?
JamesPF: My thinking is that the students in the WQ w/jigsaw will have grtr self-efficacy
beliefs and collective efficacy beliefs
JamesPF: and, grtr structural knw
JimCGst21 left the room.
BernieD: 2br apt w rvr vw
MarkAH: I have some news regarding research designs that may be of interest to this
group....
BernieD: Take it away, Mark.
MarkAH: ... the US Dept of Ed is proposing adopting a specific set of "approved" research
designs for projects they fund. I've put this list on Bernie's whiteboard. This could
strongly impact the way we go about research on topics like webquests.
|
"The Secretary proposes a priority for program projects
proposing an evaluation plan that is based on rigorous scientifically based
research methods to assess
the effectiveness of a particular intervention. The Secretary intends that this
priority will allow program participants and the Department to determine whether
the project produces meaningful effects on student achievement or teacher performance.
*??Evaluation methods using an experimental design are best for determining
project effectiveness. Thus, the project should use an experimental design
under which
participants--e.g., students, teachers, classrooms, or schools--are randomly
assigned to participate in the project activities being evaluated or
to a control group
that does not participate in the project activities being evaluated.???
*??If random assignment is not feasible, the project may use a quasi-experimental
design with carefully matched comparison conditions. This alternative design
attempts to approximate a randomly assigned control group by matching participants--e.g.,
students, teachers, classrooms, or schools--with non-participants having
similar pre-program characteristics.
*??In cases where random assignment is not possible and an extended series
of observations of the outcome of interest precedes and follows the introduction
of a new program
or practice, regression discontinuity designs may be employed.
*??For projects that are focused on special populations in which sufficient
numbers of participants are not available to support random assignment
or matched comparison
group designs, single-subject designs such as multiple baseline or treatment-reversal
or interrupted time series that are capable of demonstrating causal relationships
can be employed.
|
BernieD: Seems as though they're not too keen on qualitative methods.
MarkAH: No
BernieD: Which flies in the face of the research courses in most programs these days.
CarolynHK: not politic
Jan_NS left the room.
JamesPF: We used a coin toss to determine which class would get the jigsaw
JamesPF: Then, the students roles and cities to study were picked out of a hat
TomMarch: Gotta go, folks. Stay in touch and so will I.
JamesPF: Trying to leave this stuff to "chance" may make the study more respectable
BernieD: That's as close to experimental as you can get with an actual course.
JamesPF: Will do, Tom
BernieD: Nite Tom (or g'day, I guess)
MarkAH: I don't think they think about actual classrooms
TomMarch left the room (signed off).
Jan_NS joined the room.
BernieD: Well... this is about program evaluations for funded projects, and that's
not the same as what doc students do.
Jan_NS left the room (signed off).
MarkAH . o O ( Have to move on. Thanks Bernie for the talk )
BernieD: (I've got to fix that revolving door)
BernieD: Thanks for the DoE info Mark
MarkAH waves bye
MarkAH left the room (signed off).
CarolynHK: me too..thanks all...very interesting.
CarolynHK left the room (signed off).
BernieD: Thanks to all of you for coming... especially James who has already had a
long day
BernieD: I'll send you the transcript of what you missed, James.
JamesPF: Thank you!
JeanneP: Thanks, Bernie. And on a side note-- thanks for all of the fabulous resources
on your site.
KristinaR: thank you Bernie and James
BernieD: You're quite welcome. More to come.
BernieD: Nite all.
BernieD left the room (signed off).
|