Test Design & Development Flashcards
7 cards from real CASAS practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Test Design & Development flashcards as text
CASAS assessments are best classified as which type of test?
Answer: Criterion-referenced tests that measure performance against defined standards
CASAS assessments are criterion-referenced, meaning scores indicate mastery of specific competencies rather than rank among peers.
Which type of validity evidence is most directly supported by having subject matter experts review CASAS items against the competency framework?
Answer: Content validity
Content validity is established when experts confirm that test items adequately represent the full range of skills and competencies the test is designed to measure.
The standard error of measurement (SEM) is used in CASAS score interpretation to:
Answer: Estimate the range in which a test-taker's true score likely falls
SEM quantifies measurement error, allowing educators to construct a confidence interval around an observed score to approximate the test-taker's true ability.
How does CASAS ensure score comparability across its multiple equivalent test forms?
Answer: Through an item bank with IRT-based scaled scores
CASAS maintains a calibrated item bank using IRT, so scaled scores are comparable regardless of which form a test-taker completes.
Test-retest reliability refers to:
Answer: The consistency of scores when the same group takes the same test at two points in time
Test-retest reliability measures score stability over time by correlating results from two administrations of the same instrument to the same group.
In CASAS test development, what does 'construct validity' specifically require evidence of?
Answer: That the test accurately measures the underlying skill or ability it is intended to assess
Construct validity requires demonstrating that test scores reflect the theoretical construct (e.g., reading comprehension) being measured, not irrelevant factors.
Which principle of test fairness is central to the CASAS development process?
Answer: Test items must not systematically disadvantage any identifiable subgroup of test-takers
Fairness in test development requires that items be free of differential item functioning (DIF) so no subgroup is systematically penalized by content irrelevant to the skill measured.