ATP ATP Test Development & Design 2

Question 1

Which standard-setting method involves panelists rating the difficulty of items for a 'borderline' examinee?

Accepted Answer

Angoff Method

Answer

The Angoff method asks panelists to estimate the probability that a minimally competent examinee would answer each item correctly.

Question 2

What is the purpose of an 'item stem' in a multiple-choice question?

Accepted Answer

To present the question or problem to be solved

Answer

The item stem is the part of a multiple-choice question that presents the problem or question the examinee must answer.

Question 3

What is 'differential item functioning' (DIF)?

Accepted Answer

A condition where items perform differently for subgroups with similar ability levels

Answer

DIF occurs when an item performs differently for subgroups (e.g., by gender or ethnicity) after controlling for overall ability.

Question 4

In test form construction, what is 'test equating'?

Accepted Answer

A statistical process to ensure scores from different forms are comparable

Answer

Test equating is a statistical process that adjusts scores from different test forms so they can be compared on a common scale.

Question 5

What is the role of a 'subject matter expert' (SME) in test development?

Accepted Answer

To provide domain knowledge for item writing and review

Answer

Subject matter experts provide domain knowledge and professional judgment during item writing, review, and standard setting.

ATP - Association of Test Publishers Practice Test