CBT Adaptive Testing and Computer Adaptive Testing (CAT) 3

Question 1

Which of the following is a major criticism of using Maximum Information (MI) item selection without additional constraints in CAT?

Accepted Answer

It tends to overexpose a small subset of highly informative items

Answer

Unconstrained MI selection repeatedly chooses the same high-information items for examinees at similar ability levels, depleting those items quickly and creating security vulnerabilities.

Question 2

Compared to a traditional paper-and-pencil fixed-form test, a well-designed CAT of equivalent precision typically requires:

Accepted Answer

Fewer items to achieve the same reliability

Answer

Because CAT targets each item to the examinee's ability level, it achieves equivalent measurement precision with roughly 50% fewer items compared to a fixed-form test.

Question 3

Polytomous IRT models (e.g., Graded Response Model) are used in CAT when:

Accepted Answer

Items have multiple ordered score categories (partial credit)

Answer

Polytomous models like the GRM or Partial Credit Model handle items that can be scored in more than two ordered categories, such as constructed-response or rating-scale items.

Question 4

Which regulatory or professional body publishes standards that address fairness and validity concerns specific to adaptive testing?

Accepted Answer

The Standards for Educational and Psychological Testing (AERA/APA/NCME)

Answer

The Standards for Educational and Psychological Testing, jointly published by AERA, APA, and NCME, provides authoritative guidance on validity, fairness, and reliability requirements applicable to adaptive tests.

Question 5

In a CAT, construct-irrelevant variance introduced by adaptive item selection can occur when:

Accepted Answer

The adaptive algorithm systematically exposes certain subgroups to different content domains

Answer

If subgroup differences in ability lead the algorithm to route groups to systematically different content areas, test content may inadvertently vary across groups, threatening construct validity and fairness.

CBT - Computer Based Testing Practice Test

CBT - Computer Based Testing Practice Test

CBT Adaptive Testing and Computer Adaptive Testing (CAT) 3