CBT Scoring Models and Reporting 4

Question 1

What distinguishes horizontal equating from vertical scaling in CBT?

Accepted Answer

Horizontal equating links forms of similar difficulty at the same level; vertical scaling links forms across developmental levels

Answer

Horizontal equating connects parallel forms measuring the same construct at the same level, while vertical scaling links forms across different ability or grade levels.

Question 2

A score report includes a 'confidence band' around a candidate's score. What does this band communicate?

Accepted Answer

The interval within which the true score likely falls

Answer

A confidence band (±1 or ±2 SEM) shows the range where the candidate's true score most likely lies, acknowledging inherent measurement uncertainty.

Question 3

Which reporting practice best supports fairness by ensuring no single demographic group's results are systematically over- or under-reported?

Accepted Answer

Disaggregating score data by subgroups

Answer

Disaggregating scores by demographic subgroups allows stakeholders to identify and address performance gaps that may signal bias or inequity.

Question 4

In CBT score reporting, what is 'scale drift' and why is it a concern?

Accepted Answer

When the score scale gradually shifts over time, making comparisons across years invalid

Answer

Scale drift occurs when equating errors accumulate across testing cycles, causing scores from different years to no longer be truly comparable.

Question 5

A CBT uses a 'mastery model' scoring approach. Which outcome does this model produce?

Accepted Answer

A pass/fail determination based on meeting a competency threshold

Answer

Mastery models classify candidates as either having demonstrated sufficient competency (pass) or not (fail), rather than providing a continuous score.

CBT - Computer Based Testing Practice Test

CBT - Computer Based Testing Practice Test

CBT Scoring Models and Reporting 4