CBT Psychometric Principles and Analysis 3

Question 1

A passing score on a licensure exam is set by having subject matter experts rate the minimum competency required to answer each item correctly. This method is called:

Accepted Answer

The Angoff method

Answer

The Angoff method asks judges to estimate the probability that a minimally competent examinee would answer each item correctly, and averages these ratings to set the cut score.

Question 2

In generalizability theory, the 'universe score' is conceptually analogous to which classical test theory concept?

Accepted Answer

True score

Answer

The universe score in G-theory represents the expected score over all conditions of measurement, paralleling the true score in classical test theory.

Question 3

Which type of score interpretation compares an examinee's performance to a defined content domain rather than to other examinees?

Accepted Answer

Criterion-referenced interpretation

Answer

Criterion-referenced interpretation evaluates mastery of a defined domain, reporting what an examinee can or cannot do rather than comparing them to a normative group.

Question 4

An examinee's score on a cognitive test is 115. The test has a reliability of 0.84 and a mean of 100. What concept explains why the examinee's true score estimate should be pulled toward the mean?

Accepted Answer

Regression to the mean

Answer

Regression to the mean occurs because observed scores contain measurement error; true score estimates are weighted averages of the observed score and the group mean, pulled toward the mean by unreliability.

Question 5

What does a negative point-biserial correlation for a test item most likely indicate?

Accepted Answer

Higher-scoring examinees tend to answer the item incorrectly

Answer

A negative point-biserial means low total scorers pass the item more than high scorers, suggesting the item is flawed, miskeyed, or measures something different from the rest of the test.

CBT - Computer Based Testing Practice Test

CBT - Computer Based Testing Practice Test

CBT Psychometric Principles and Analysis 3