Assessment Design Flashcards

Split-half reliability is a method used to estimate which type of assessment quality?

Answer: Internal consistency

Split-half reliability estimates internal consistency by correlating scores from two halves of the same assessment.

When designing performance tasks for Ohio's state assessments, which element is MOST important to define first?

Answer: The clear learning target or standard being assessed

Identifying the specific learning target ensures that all elements of the performance task align to what students need to demonstrate.

Which statement BEST describes the difference between norm-referenced and criterion-referenced tests?

Answer: Norm-referenced tests compare students to peers; criterion-referenced tests compare to a standard

Norm-referenced tests rank students relative to a norming group, while criterion-referenced tests measure performance against a defined standard.

In assessment design, 'washback effect' refers to:

Answer: The influence of an assessment on teaching and learning behaviors

Washback (or backwash) is the impact that an assessment has on instructional practices and curriculum decisions.

A test designed so that no single demographic group consistently scores higher due to cultural or linguistic factors demonstrates:

Answer: Assessment bias elimination / fairness

A fair assessment is one where scores reflect actual knowledge, not advantages or disadvantages tied to cultural or linguistic background.

Which data source would BEST help a test developer identify items that are functioning differently for English learners compared to non-English learners?

Answer: Differential Item Functioning (DIF) analysis

DIF analysis detects items that perform unexpectedly differently for specific subgroups, signaling potential bias.

Ohio's tiered system of support (MTSS) uses assessment data primarily to:

Answer: Identify students needing additional instructional support and guide interventions

MTSS relies on assessment data to identify students at risk and match them to appropriate levels of instructional intervention.