Assessment and Evaluation Methods Flashcards

Which term describes the process of using multiple types of evidence—tests, observations, and work samples—to make an assessment decision?

Answer: Triangulation

Triangulation strengthens assessment validity by drawing on several data sources rather than a single measure.

Interrater reliability refers to:

Answer: The degree to which different scorers agree when evaluating the same work

Interrater reliability measures agreement between two or more raters scoring identical student responses.

On the GLA, extended-response questions are evaluated primarily to assess a student's ability to:

Answer: Construct a coherent, evidence-based written argument

Extended-response items measure higher-order literacy skills, especially the ability to synthesize evidence and form logical arguments.

A scaled score differs from a raw score because it:

Answer: Converts raw points to a standardized scale across test forms

Scaled scores allow fair comparison across different test versions by placing all scores on a common scale.

Which action best supports washback—the positive influence of an assessment on teaching and learning?

Answer: Using assessment results to redesign instruction

Positive washback occurs when assessment data directly informs and improves instructional decisions and practices.

A student scores in the 'Basic' performance level on a state literacy assessment. This type of reporting uses which scale?

Answer: Performance level descriptors

Performance level descriptors (e.g., Below Basic, Basic, Proficient, Advanced) categorize students by mastery thresholds rather than numerical rank.

Which scenario represents a potential source of construct-irrelevant variance in a literacy assessment?

Answer: Using passages on topics unfamiliar to certain cultural groups

Culturally unfamiliar content may cause score differences unrelated to literacy skill, introducing construct-irrelevant variance.