CBT Psychometric Principles and Analysis 5

Question 1

Which of the following is the primary advantage of polytomous IRT models (e.g., Graded Response Model) over dichotomous models?

Accepted Answer

They model ordered response categories, capturing more score information per item

Answer

Polytomous models explicitly account for multiple ordered response options (e.g., Likert scales), extracting more information from each item than a simple pass/fail scoring.

Question 2

Which statistic is most appropriate for estimating reliability when a test has items scored on multiple response categories (e.g., 0–3 points each)?

Accepted Answer

Coefficient alpha (Cronbach's alpha)

Answer

KR-20 is limited to dichotomous items; Cronbach's alpha is the appropriate generalization for items with multiple score points or continuous responses.

Question 3

In a multitrait-multimethod (MTMM) matrix, convergent validity is supported when:

Accepted Answer

Correlations between the same trait measured by different methods are high

Answer

Convergent validity in MTMM is evidenced by high correlations in the validity diagonal—same trait, different methods—indicating the construct is being measured consistently.

Question 4

A test developer wants to assess whether scores predict job performance 6 months after hiring. Which validity study design should be used?

Accepted Answer

Predictive criterion-related validity study

Answer

Predictive validity studies collect test scores first, then measure criterion performance after a time interval, directly evaluating the test's forecasting utility.

Question 5

Which of the following best defines 'construct underrepresentation' as a threat to validity?

Accepted Answer

The test fails to capture important facets of the intended construct

Answer

Construct underrepresentation occurs when the test is too narrow and omits important aspects of the construct, limiting the generalizability of score interpretations.

CBT - Computer Based Testing Practice Test

CBT - Computer Based Testing Practice Test

CBT Psychometric Principles and Analysis 5