NES Research & Evidence-Based Practice 3 — Questions and Answers
Question 1: Which term describes the degree to which research findings can be applied to other settings, populations, or times?
- Reliability
- Internal validity
- Generalizability (Correct answer)
- Objectivity
Correct answer: Generalizability
Generalizability (also called external validity) refers to how well research results apply beyond the original study's specific context.
Question 2: A teacher systematically collects and analyzes data from her own classroom to improve instruction. This is an example of:
- Basic research
- Action research (Correct answer)
- Meta-analysis
- Quasi-experimental research
Correct answer: Action research
Action research is practitioner-led inquiry conducted within one's own educational setting to solve immediate problems.
Question 3: What is the primary purpose of using a control group in an experiment?
- To increase sample size
- To provide a baseline for comparison (Correct answer)
- To ensure participants are motivated
- To eliminate measurement error
Correct answer: To provide a baseline for comparison
A control group provides a baseline so researchers can determine whether observed changes result from the intervention rather than other factors.
Question 4: Which data collection method would BEST capture the depth of a student's reasoning about a math problem?
- Standardized multiple-choice test
- Think-aloud protocol (Correct answer)
- Attendance record
- Norm-referenced assessment
Correct answer: Think-aloud protocol
A think-aloud protocol has students verbalize their thought processes, providing rich qualitative insight into reasoning strategies.
Question 5: Interrater reliability is important in research because it ensures that:
- The same participant scores consistently over time
- Different observers produce consistent results when rating the same behavior (Correct answer)
- The instrument measures the intended construct
- The sample represents the population
Correct answer: Different observers produce consistent results when rating the same behavior
Interrater reliability measures the consistency of scores across different observers, reducing subjectivity in qualitative or observational data.
Question 6: A researcher reviews and statistically combines data from 30 separate studies on vocabulary instruction. This is called a:
- Literature review
- Meta-analysis (Correct answer)
- Case study
- Longitudinal study
Correct answer: Meta-analysis
A meta-analysis quantitatively synthesizes findings from multiple studies, producing an overall effect size estimate.
Question 7: Which level of evidence is generally considered the STRONGEST for supporting instructional decisions?
- Expert opinion
- Single case study
- Systematic review or meta-analysis (Correct answer)
- Teacher anecdote
Correct answer: Systematic review or meta-analysis
Systematic reviews and meta-analyses sit at the top of the evidence hierarchy because they synthesize findings from multiple rigorous studies.
NES Research & Evidence-Based Practice 3
Which term describes the degree to which research findings can be applied to other settings, populations, or times?