CBT Adaptive Testing and Computer Adaptive Testing (CAT) 3

Question 1

Which of the following is a major criticism of using Maximum Information (MI) item selection without additional constraints in CAT?

Accepted Answer

It tends to overexpose a small subset of highly informative items

Answer

It results in tests that are too short

Answer

It cannot be implemented in real-time delivery systems

Answer

It requires polytomous scoring for all items

Question 2

Compared to a traditional paper-and-pencil fixed-form test, a well-designed CAT of equivalent precision typically requires:

Accepted Answer

Fewer items to achieve the same reliability

Answer

More items to achieve the same reliability

Answer

The same number of items with higher administration cost

Answer

More items but lower standard error

Question 3

Polytomous IRT models (e.g., Graded Response Model) are used in CAT when:

Accepted Answer

Items have multiple ordered score categories (partial credit)

Answer

Items have only right/wrong scoring

Answer

The item bank contains only multiple-choice items

Answer

Exposure control is not required

Question 4

Which regulatory or professional body publishes standards that address fairness and validity concerns specific to adaptive testing?

Accepted Answer

The Standards for Educational and Psychological Testing (AERA/APA/NCME)

Answer

The International Air Transport Association (IATA)

Answer

The Institute of Electrical and Electronics Engineers (IEEE)

Answer

The American Medical Association (AMA)

Question 5

In a CAT, construct-irrelevant variance introduced by adaptive item selection can occur when:

Accepted Answer

The adaptive algorithm systematically exposes certain subgroups to different content domains

Answer

Items are too easy for all examinees

Answer

Item banks are calibrated using large samples

Answer

All items are scored dichotomously

Question 6

The conditional standard error of measurement (CSEM) in IRT-based CAT is best described as:

Accepted Answer

The precision of the ability estimate at a specific theta value

Answer

A fixed value applied uniformly across all ability levels

Answer

The average error across all examinees in a test form

Answer

The proportion of items answered incorrectly

Question 7

Which of the following best supports the argument that equating is less of a concern in CAT than in fixed-form testing?

Accepted Answer

IRT ability estimates are placed on a common scale during item calibration, making form-to-form equating largely unnecessary

Answer

CAT uses the same item each time, eliminating form differences

Answer

CAT does not require score reporting

Answer

All examinees receive identical items in CAT