Scoring Models and Reporting Flashcards
7 cards from real CBT practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Scoring Models and Reporting flashcards as text
What distinguishes horizontal equating from vertical scaling in CBT?
Answer: Horizontal equating links forms of similar difficulty at the same level; vertical scaling links forms across developmental levels
Horizontal equating connects parallel forms measuring the same construct at the same level, while vertical scaling links forms across different ability or grade levels.
A score report includes a 'confidence band' around a candidate's score. What does this band communicate?
Answer: The interval within which the true score likely falls
A confidence band (±1 or ±2 SEM) shows the range where the candidate's true score most likely lies, acknowledging inherent measurement uncertainty.
Which reporting practice best supports fairness by ensuring no single demographic group's results are systematically over- or under-reported?
Answer: Disaggregating score data by subgroups
Disaggregating scores by demographic subgroups allows stakeholders to identify and address performance gaps that may signal bias or inequity.
In CBT score reporting, what is 'scale drift' and why is it a concern?
Answer: When the score scale gradually shifts over time, making comparisons across years invalid
Scale drift occurs when equating errors accumulate across testing cycles, causing scores from different years to no longer be truly comparable.
A CBT uses a 'mastery model' scoring approach. Which outcome does this model produce?
Answer: A pass/fail determination based on meeting a competency threshold
Mastery models classify candidates as either having demonstrated sufficient competency (pass) or not (fail), rather than providing a continuous score.
The Contrasting Groups standard-setting method determines cut scores by:
Answer: Comparing score distributions of known masters and non-masters
The Contrasting Groups method finds the cut score where the score distributions of clearly competent and clearly incompetent groups intersect.
When a CBT score report displays 'diagnostic feedback,' this typically includes:
Answer: Performance summaries by content domain or objective
Diagnostic feedback aggregates performance by content domain or objective, showing relative strengths and weaknesses without revealing specific item content.