ODE Assessment Design 2 — Questions and Answers
Question 1: Which type of validity evidence examines whether an assessment's content adequately represents the domain it is intended to measure?
- Construct validity
- Content validity (Correct answer)
- Concurrent validity
- Predictive validity
Correct answer: Content validity
Content validity ensures the assessment items represent the full scope of the intended learning domain.
Question 2: A teacher designs a rubric with clearly defined performance levels for each criterion. This rubric is BEST described as:
- Holistic rubric
- Single-point rubric
- Analytic rubric (Correct answer)
- Checklist rubric
Correct answer: Analytic rubric
Analytic rubrics break down performance into distinct criteria, each with defined levels of achievement.
Question 3: In ODE's assessment framework, which term describes the degree to which an assessment measures what it claims to measure?
- Reliability
- Validity (Correct answer)
- Fairness
- Standardization
Correct answer: Validity
Validity is the extent to which an assessment accurately measures the intended construct or skill.
Question 4: A district wants to compare student performance across multiple classrooms using the same assessment. Which feature is most critical?
- Adaptive scoring
- Standardized administration conditions (Correct answer)
- Open-ended response format
- Portfolio-based evidence
Correct answer: Standardized administration conditions
Standardized administration ensures scores are comparable across different classrooms and testing conditions.
Question 5: Which cognitive level in Bloom's Taxonomy involves students breaking down information into component parts to explore relationships?
- Applying
- Understanding
- Analyzing (Correct answer)
- Evaluating
Correct answer: Analyzing
Analyzing requires students to deconstruct content and examine how parts relate to each other.
Question 6: An assessment item that is consistently answered correctly by high-performing students and incorrectly by low-performing students demonstrates:
- Low item difficulty
- Negative item discrimination
- Positive item discrimination (Correct answer)
- High item reliability
Correct answer: Positive item discrimination
Positive item discrimination means the item effectively differentiates between high- and low-performing students.
Question 7: Which accommodation on a state assessment allows a student with a visual impairment to access the same content without changing what is being measured?
- Extended time only
- Simplified language version
- Large print or braille format (Correct answer)
- Reduced number of items
Correct answer: Large print or braille format
Large print or braille provides access to the same content and construct without altering the assessment's intent.
ODE Assessment Design 2
Which type of validity evidence examines whether an assessment's content adequately represents the domain it is intended to measure?