SAEE SAEE - Data Collection and Analysis Questions and Answers 4 — Questions and Answers
Question 1: A school leader reviews a report showing that the average GPA of students enrolled in after-school tutoring rose from 2.1 to 2.6. Without a control group, this finding is best described as:
- Conclusive evidence the program caused improvement
- A correlation that cannot establish causation (Correct answer)
- Statistically significant by default
- Invalid data that should be discarded
Correct answer: A correlation that cannot establish causation
Without a control group, it is impossible to rule out alternative explanations for the GPA increase.
Question 2: Which term describes the degree to which a test consistently produces the same results across repeated administrations?
- Validity
- Reliability (Correct answer)
- Norming
- Triangulation
Correct answer: Reliability
Reliability refers to the consistency of a measurement instrument across different administrations or raters.
Question 3: A principal uses demographic data, attendance records, and teacher observations together to understand a student's chronic absenteeism. This practice is called:
- Disaggregation
- Triangulation (Correct answer)
- Stratification
- Extrapolation
Correct answer: Triangulation
Triangulation involves using multiple data sources to develop a more complete and accurate understanding of an issue.
Question 4: A district separates student performance data by race, gender, and socioeconomic status to identify achievement gaps. This analytical process is called:
- Data triangulation
- Data disaggregation (Correct answer)
- Normative referencing
- Criterion referencing
Correct answer: Data disaggregation
Disaggregation breaks down aggregate data into subgroups to reveal disparities that might otherwise be hidden.
Question 5: An administrator wants to know whether a new literacy program produced statistically significant gains. Which step should be taken FIRST?
- Present the data to the school board
- Collect pre- and post-program assessment data (Correct answer)
- Eliminate students with low baseline scores
- Survey parents about their satisfaction
Correct answer: Collect pre- and post-program assessment data
Collecting pre- and post-program data establishes a baseline necessary for measuring program impact.
Question 6: A test measures what it is intended to measure. This is a definition of:
- Reliability
- Norming
- Validity (Correct answer)
- Standard error
Correct answer: Validity
Validity is the extent to which an assessment actually measures the construct or skill it is designed to assess.
Question 7: A school's overall graduation rate is 90%, but only 70% of English language learners graduate. Which data practice revealed this disparity?
- Normative referencing
- Data triangulation
- Disaggregation by subgroup (Correct answer)
- Criterion referencing
Correct answer: Disaggregation by subgroup
Disaggregating data by subgroup exposes differences in outcomes that aggregate statistics conceal.
SAEE SAEE - Data Collection and Analysis Questions and Answers 4
A school leader reviews a report showing that the average GPA of students enrolled in after-school tutoring rose from 2.1 to 2.6.
Without a control group, this finding is best described as: