Item Analysis Flashcards

A test item has a point-biserial correlation of -0.15. What does this indicate?

Answer: High-scoring students tend to answer it incorrectly

A negative point-biserial correlation means higher-ability students are more likely to get the item wrong, signaling a flawed or ambiguous item.

Which distractor characteristic is MOST desirable in a well-constructed multiple-choice item?

Answer: Distractors are chosen more often by low-scoring students than by high-scoring students

Effective distractors attract low-performing students while being rejected by high-performing students, supporting the item's ability to discriminate.

On the M-STEP, what is the primary purpose of conducting item analysis after field testing?

Answer: To evaluate whether items function as intended across student subgroups

Item analysis after field testing checks whether each item functions fairly and effectively for all student subgroups before being included on the operational test.

An item's facility index (p-value) is 0.95. How should test developers interpret this?

Answer: Almost all students answered the item correctly, so it may be too easy

A p-value of 0.95 means 95% of students answered correctly, indicating the item is very easy and may add little discriminating information.

Which index is used to detect differential item functioning (DIF) during item analysis?

Answer: Mantel-Haenszel statistic

The Mantel-Haenszel statistic is a widely used method for detecting DIF by comparing item performance across focal and reference groups at matched ability levels.

In item analysis, what does it mean when an item has a high discrimination index but a very low p-value?

Answer: The item is difficult but effectively separates high and low performers

A high discrimination index with a low p-value indicates the item is hard but still useful for distinguishing between students with different ability levels.

A teacher reviews item analysis data and notices that Option C on one item was chosen by 0% of students. What should the teacher conclude?

Answer: Option C is a non-functional distractor that should be revised

A distractor chosen by no students is non-functional and provides no diagnostic information; it should be rewritten to be more plausible.