NES Quality Control & Assurance 5 — Questions and Answers
Question 1: A school's data team notices that ELL students consistently score lower on a science assessment that requires extensive reading. This likely indicates:
- ELL students lack science knowledge
- The test may measure language proficiency as much as science understanding (Correct answer)
- The teacher needs additional science content training
- The assessment is appropriately rigorous for all students
Correct answer: The test may measure language proficiency as much as science understanding
When ELL students underperform on content tests with heavy language demands, the assessment may be measuring language ability rather than the intended science construct.
Question 2: Which of the following BEST describes inter-rater reliability?
- The consistency of scores when the same test is taken twice
- The degree to which multiple scorers assign similar scores to the same work (Correct answer)
- The alignment between test items and learning objectives
- The stability of scores across different test forms
Correct answer: The degree to which multiple scorers assign similar scores to the same work
Inter-rater reliability measures the extent to which different scorers agree when evaluating the same student response.
Question 3: A principal wants to use student growth data rather than proficiency rates to evaluate school effectiveness. Which rationale BEST supports this choice?
- Growth data eliminates the need for standardized testing
- Growth measures account for where students started, making comparisons fairer across schools with different demographics (Correct answer)
- Growth data is easier to collect than proficiency data
- Growth measures replace the need for disaggregated subgroup analysis
Correct answer: Growth measures account for where students started, making comparisons fairer across schools with different demographics
Growth models control for prior achievement, allowing fairer comparisons between schools serving different student populations.
Question 4: Which testing accommodation is designed to ensure that a student with a visual impairment can demonstrate knowledge without being disadvantaged by the test format?
- Extended time for all students
- Large-print or screen-reader version of the test (Correct answer)
- Reducing the number of questions on the test
- Allowing a peer to assist with answering questions
Correct answer: Large-print or screen-reader version of the test
Format accommodations like large print or screen readers remove access barriers without altering the construct being measured.
Question 5: A school's reading scores on the state test improve dramatically the year after the test format is changed to multiple choice only. Before celebrating, leaders should consider:
- Whether the score gains reflect true learning or changes in what the test measures (Correct answer)
- How to sustain the score gains by eliminating open-ended items permanently
- Whether to share the results publicly before further analysis
- How to use the scores to evaluate individual teacher performance
Correct answer: Whether the score gains reflect true learning or changes in what the test measures
When test format changes coincide with score gains, it is critical to determine whether improvement reflects real learning or reduced construct coverage.
Question 6: Which protocol MOST effectively ensures standardized test administration across multiple classrooms?
- Allowing each teacher to explain confusing directions in their own words
- Providing a verbatim script and training all proctors before administration (Correct answer)
- Letting students choose their own testing location and time
- Permitting teachers to answer student content questions during the test
Correct answer: Providing a verbatim script and training all proctors before administration
Verbatim scripts and proctor training ensure all students receive identical conditions, which is essential for fair and valid test comparisons.
Question 7: A curriculum coordinator reviews assessment results and finds that one question was answered incorrectly by 92% of students across all classrooms. The MOST likely explanation is:
- Students did not study hard enough
- The item is flawed, ambiguous, or was not covered in instruction (Correct answer)
- The test should be made easier overall
- Teachers need to assign more homework on that topic
Correct answer: The item is flawed, ambiguous, or was not covered in instruction
Near-universal failure on a single item usually signals a flawed or ambiguous question, or a significant instructional gap, both of which require item-level review.
NES Quality Control & Assurance 5
A school's data team notices that ELL students consistently score lower on a science assessment that requires extensive reading.
This likely indicates: