CBT Adaptive Testing and Computer Adaptive Testing (CAT) 2

Question 1

The ability estimate (theta) in a CAT is updated after each item response using:

Accepted Answer

Maximum Likelihood Estimation (MLE) or Bayesian estimation

Answer

CAT systems iteratively update theta using MLE or Bayesian methods (such as EAP or MAP) after each item response to refine the ability estimate.

Question 2

Shadow testing in CAT refers to:

Accepted Answer

Constructing a complete ghost test that satisfies all constraints before selecting the next item

Answer

Shadow testing builds a full, constraint-satisfying test in the background at each step and selects the next item from that shadow test, ensuring all blueprint and exposure constraints will be met.

Question 3

A CAT that uses a three-parameter logistic (3PL) IRT model accounts for which additional parameter compared to the 1PL (Rasch) model?

Accepted Answer

Item discrimination and guessing (pseudo-chance)

Answer

The 3PL model adds discrimination (a) and pseudo-guessing (c) parameters to the difficulty (b) parameter of the Rasch model, accounting for the probability of correct response by low-ability examinees through guessing.

Question 4

Early termination rules in mastery-based CAT (e.g., licensure tests) are triggered when:

Accepted Answer

The algorithm is sufficiently confident the examinee is above or below the passing standard

Answer

Mastery CATs use sequential probability ratio tests or similar decision rules to stop early when the probability of misclassifying the examinee falls below an acceptable error rate.

Question 5

Which of the following best describes item parameter drift in the context of CAT?

Accepted Answer

A change in an item's statistical properties over time due to repeated exposure or population shifts

Answer

Item parameter drift occurs when an item's IRT parameters (b, a, c) change from their calibrated values, often because the item has been exposed and memorized or because the examinee population has shifted.

CBT - Computer Based Testing Practice Test

CBT - Computer Based Testing Practice Test

CBT Adaptive Testing and Computer Adaptive Testing (CAT) 2