ATP Quality Control & Assurance 2

Question 1

Which statistical method is used to monitor test item performance over time by tracking mean scores across administrations?

Accepted Answer

Statistical process control (SPC)

Answer

Statistical process control uses control charts to monitor whether item and test statistics remain within acceptable bounds across administrations.

Question 2

In test development QA, a 'form blueprint' primarily ensures which quality characteristic?

Accepted Answer

Content validity and coverage

Answer

A form blueprint specifies the content domains, cognitive levels, and item counts required, ensuring the test adequately covers the intended construct.

Question 3

A QA review finds that 15% of items in a final form have p-values below 0.20. What is the most appropriate action?

Accepted Answer

Flag items for content review and possible replacement

Answer

Extremely low p-values may indicate ambiguous wording, keying errors, or misalignment with instruction, requiring content review before the form is used.

Question 4

Which process ensures that scores from two different test forms are comparable before results are reported?

Accepted Answer

Equating

Answer

Equating adjusts for differences in difficulty between forms so that a given scaled score represents the same level of proficiency regardless of which form was taken.

Question 5

The ATP Code of Fair Testing Practices requires that tests be reviewed for potential bias against subgroups. Which review method evaluates qualitative fairness concerns?

Accepted Answer

Sensitivity review by trained panelists

Answer

Sensitivity reviews use trained reviewers from diverse backgrounds to flag offensive, stereotyping, or culturally biased content before statistical analyses are run.

ATP - Association of Test Publishers Practice Test

ATP - Association of Test Publishers Practice Test

ATP Quality Control & Assurance 2