Assessment Design Flashcards

A school district uses the same standardized test across all grade levels to compare student performance. This approach most directly enables:

Answer: Vertical scaling

Vertical scaling places scores from different grade-level tests on a common scale, enabling comparisons of growth across grades.

Which item format produces the MOST scoring subjectivity?

Answer: Open-ended essay

Open-ended essay items require human judgment to score, introducing greater variability between raters compared to selected-response formats.

An assessment is described as 'reliable' when it:

Answer: Produces consistent scores across administrations

Reliability refers to the consistency of scores — a reliable test yields similar results under similar conditions.

When a test item is flagged through Differential Item Functioning (DIF) analysis, it means:

Answer: Students of equal ability from different groups respond differently to the item

DIF analysis identifies items where examinees from different demographic groups with the same overall ability have different probabilities of answering correctly.

Which of the following BEST describes criterion-referenced score interpretation?

Answer: Evaluating performance against a fixed standard or cut score

Criterion-referenced interpretation evaluates whether a student has met a predetermined performance standard, independent of how others performed.

A test developer includes anchor items in two different test forms. The PRIMARY purpose of anchor items is to:

Answer: Equate scores across different test forms

Anchor items appear on multiple test forms and are used in equating procedures to place scores from different forms on the same scale.

Which assessment design strategy BEST reduces the impact of test-taking anxiety on scores?

Answer: Providing practice tests and clear directions beforehand

Familiarizing students with test format and conditions through practice reduces anxiety and prevents it from artificially lowering scores.