ATP Quality Control & Assurance 4

Question 1

A testing vendor uses a 'four-eyes principle' during form assembly. What quality control purpose does this serve?

Accepted Answer

Requiring a second reviewer to verify decisions made by the first

Answer

The four-eyes principle mandates independent verification by a second person, reducing the risk of undetected errors in form assembly, key entry, or blueprint compliance.

Question 2

Which threat to test quality occurs when examinees' scores are influenced by their familiarity with test-taking strategies rather than the target construct?

Accepted Answer

Construct-irrelevant variance

Answer

Construct-irrelevant variance is introduced when scores reflect factors unrelated to the intended construct, such as test-wiseness, reducing validity of score interpretations.

Question 3

A post-administration QA review reveals a significant drop in mean scores compared to prior administrations. Which should be investigated first?

Accepted Answer

Possible form assembly or administration errors

Answer

Sudden score drops most immediately suggest a quality failure such as an incorrect answer key, form misrouting, or administration irregularity that must be ruled out before other explanations.

Question 4

Under the ATP's Standards for Educational and Psychological Testing framework, which term describes the degree to which evidence supports a specific interpretation of test scores?

Accepted Answer

Validity

Answer

Validity refers to the degree to which evidence and theory support the interpretations of test scores for proposed uses, making it the central quality concept in the Standards.

Question 5

Which item statistic indicates the degree to which an item discriminates between high- and low-performing examinees?

Accepted Answer

Point-biserial correlation

Answer

The point-biserial correlation measures how strongly performance on a single item correlates with total test score, reflecting the item's discriminating power.

ATP - Association of Test Publishers Practice Test

ATP - Association of Test Publishers Practice Test

ATP Quality Control & Assurance 4