CBT Psychometric Principles and Analysis 2

Question 1

A test developer notices that item difficulty values (p-values) cluster around 0.90 for most items. What is the primary concern?

Accepted Answer

Items are too easy, reducing score variance and reliability

Answer

When most items have p-values near 0.90, nearly everyone answers correctly, compressing score variance and lowering reliability coefficients.

Question 2

Which of the following best describes a 'speeded test' in psychometric terms?

Accepted Answer

A test where time limits prevent most examinees from attempting all items

Answer

A speeded test is one in which the time limit is short enough that few or no examinees complete all items, so speed itself influences scores.

Question 3

In confirmatory factor analysis (CFA), a chi-square goodness-of-fit test yields p = 0.40. What does this suggest?

Accepted Answer

The model fits the data well since the result is non-significant

Answer

A non-significant chi-square (p > .05) in CFA indicates the model-implied covariance matrix does not significantly differ from the observed matrix, suggesting acceptable fit.

Question 4

What is the purpose of an anchor item set in an equating study?

Accepted Answer

To provide common reference items that link two different test forms

Answer

Anchor items appear on both the old and new test forms and serve as a statistical bridge to place scores from different forms on a common scale.

Question 5

A researcher reports Cronbach's alpha = 0.55 for a 5-item scale. Which action would most directly increase this reliability estimate?

Accepted Answer

Adding more items that measure the same construct

Answer

The Spearman-Brown prophecy formula shows that adding parallel items measuring the same construct increases the number of inter-item covariances and raises alpha.

CBT - Computer Based Testing Practice Test

CBT - Computer Based Testing Practice Test

CBT Psychometric Principles and Analysis 2