NCLB Scientifically Based Research 2 — Questions and Answers
Question 1: Under NCLB, which of the following best describes 'replication' as a feature of scientifically based research?
- Findings have been reproduced across multiple studies or sites (Correct answer)
- The study was conducted in a single school district
- The same researcher repeated the experiment once
- Results were published in two different journals
Correct answer: Findings have been reproduced across multiple studies or sites
NCLB requires that scientifically based research findings be replicated across multiple studies or settings to confirm reliability.
Question 2: Which research method is most aligned with NCLB's definition of scientifically based research when evaluating a new reading curriculum?
- A teacher survey about curriculum preferences
- A randomized controlled trial comparing the new curriculum to a control group (Correct answer)
- A focus group of parents discussing reading habits
- An analysis of historical test scores without a comparison group
Correct answer: A randomized controlled trial comparing the new curriculum to a control group
NCLB specifically values randomized controlled trials as the highest standard of evidence for evaluating educational interventions.
Question 3: NCLB requires that scientifically based research be 'presented in sufficient detail.' What does this primarily ensure?
- The study is long enough to fill a published report
- Other researchers can evaluate, replicate, or critique the methodology (Correct answer)
- The study covers all grade levels from K–12
- The findings are understandable to non-researchers
Correct answer: Other researchers can evaluate, replicate, or critique the methodology
Sufficient detail allows independent researchers to scrutinize methods, replicate findings, and assess validity.
Question 4: A principal wants to select a math intervention supported by scientifically based research. Which source best indicates compliance with NCLB's standard?
- A testimonial from a nationally known educator
- A peer-reviewed study using rigorous experimental or quasi-experimental design (Correct answer)
- A vendor brochure citing increased engagement scores
- A state education department newsletter recommending the program
Correct answer: A peer-reviewed study using rigorous experimental or quasi-experimental design
Peer-reviewed studies using rigorous experimental designs meet NCLB's scientifically based research standard.
Question 5: Under NCLB, 'objective' measurement in scientifically based research requires that data be collected in a way that is:
- Aligned with teacher observations and professional judgment
- Free from researcher bias and independently verifiable (Correct answer)
- Based primarily on student self-reporting
- Designed by the same team that developed the intervention
Correct answer: Free from researcher bias and independently verifiable
Objective measurement must be free from researcher bias and capable of independent verification to meet NCLB standards.
Question 6: Which of the following would disqualify a study from meeting NCLB's scientifically based research criteria?
- The study used a comparison group but not random assignment
- The study's findings were not published in a peer-reviewed journal and were not available for external review (Correct answer)
- The study was conducted over three academic years
- The study included students from multiple states
Correct answer: The study's findings were not published in a peer-reviewed journal and were not available for external review
NCLB requires that research be accepted by a peer-reviewed journal or reviewed by a panel of independent experts, making unpublished and unreviewed work ineligible.
Question 7: NCLB's emphasis on scientifically based research was primarily intended to ensure that federal education funds were used for:
- Programs with the longest track record regardless of evidence quality
- Programs proven effective through rigorous research (Correct answer)
- Locally developed programs tailored to community values
- Programs endorsed by national teacher unions
Correct answer: Programs proven effective through rigorous research
NCLB mandated evidence-based spending to ensure taxpayer funds supported interventions with demonstrated effectiveness.
NCLB Scientifically Based Research 2
Under NCLB, which of the following best describes 'replication' as a feature of scientifically based research?