CSET Quality Assurance & Improvement 4 — Questions and Answers
Question 1: A school finds that its reading intervention program has a large effect size in research studies but shows minimal impact in practice. Which quality improvement concept BEST explains this gap?
- Type I statistical error in the original studies
- Implementation fidelity—the program is not being delivered as designed (Correct answer)
- Regression to the mean in student scores
- Selection bias in the school's student population
Correct answer: Implementation fidelity—the program is not being delivered as designed
Implementation fidelity refers to the degree to which a program is delivered as intended; low fidelity explains why effective programs fail in practice.
Question 2: In professional learning communities (PLCs), the collaborative analysis of student work to improve instruction is MOST directly aligned with which quality improvement principle?
- Standardization of curriculum across grade levels
- Customer focus—students as the primary stakeholders
- Continuous improvement driven by evidence and reflection (Correct answer)
- Top-down leadership directing instructional change
Correct answer: Continuous improvement driven by evidence and reflection
PLCs embody continuous improvement by using student evidence collaboratively to reflect on and refine instructional practice.
Question 3: Which statistical concept helps quality improvement teams determine whether an observed change in student scores is a real improvement or due to normal random variation?
- Mean absolute deviation
- Statistical significance (Correct answer)
- Standard score (z-score)
- Median split
Correct answer: Statistical significance
Statistical significance testing determines whether an observed difference is likely a true effect rather than random chance.
Question 4: A district adopts a policy requiring all schools to submit monthly progress monitoring data for all Tier 2 intervention students. This is an example of which quality improvement strategy?
- Universal screening protocol
- Systemic progress monitoring as part of a multi-tiered support system (Correct answer)
- Summative program evaluation for grant compliance
- Criterion-referenced placement testing
Correct answer: Systemic progress monitoring as part of a multi-tiered support system
Regular progress monitoring within a tiered support system (MTSS/RTI) is a structured quality improvement strategy that tracks intervention effectiveness continuously.
Question 5: Which of the following is the MOST appropriate use of a scatter diagram in educational quality improvement?
- Tracking a single metric over time to spot trends
- Showing the frequency distribution of test scores
- Exploring whether a relationship exists between two variables, such as attendance and GPA (Correct answer)
- Ranking classrooms from highest to lowest performance
Correct answer: Exploring whether a relationship exists between two variables, such as attendance and GPA
A scatter diagram plots two variables on an x-y axis to reveal whether and how they are correlated.
Question 6: An instructional coach wants to verify that a new math curriculum is being taught with fidelity across five classrooms. Which data collection method is MOST appropriate?
- Analyzing end-of-year state test scores
- Conducting structured classroom observations using a fidelity checklist (Correct answer)
- Surveying parents about homework completion
- Reviewing lesson plan templates submitted monthly
Correct answer: Conducting structured classroom observations using a fidelity checklist
Structured observations with a fidelity checklist directly measure whether curriculum components are implemented as designed during instruction.
Question 7: The concept of 'special cause variation' in education quality improvement refers to:
- Normal fluctuations expected within any data system
- Variation due to predictable seasonal testing patterns
- Unusual variation caused by a specific, identifiable event or factor (Correct answer)
- Variation between student subgroups due to demographic differences
Correct answer: Unusual variation caused by a specific, identifiable event or factor
Special cause variation signals that something specific and identifiable—outside the normal system—is causing the unusual result.
CSET Quality Assurance & Improvement 4
A school finds that its reading intervention program has a large effect size in research studies but shows minimal impact in practice.
Which quality improvement concept BEST explains this gap?