Cambium Test Assessment Design 3 — Questions and Answers
Question 1: Which type of validity evidence examines whether an assessment's content accurately represents the domain being measured?
- Construct validity
- Content validity (Correct answer)
- Criterion validity
- Consequential validity
Correct answer: Content validity
Content validity ensures the assessment items adequately sample the full range of knowledge or skills in the target domain.
Question 2: A teacher designs a rubric with four performance levels: Beginning, Developing, Proficient, and Advanced. This is an example of a:
- Checklist
- Rating scale
- Holistic rubric (Correct answer)
- Analytic rubric
Correct answer: Holistic rubric
A holistic rubric assigns a single overall score based on a general impression of performance across multiple criteria.
Question 3: When designing a formative assessment, which characteristic is MOST important?
- High stakes consequences for students
- Immediate feedback that guides instruction (Correct answer)
- Standardized administration conditions
- Norm-referenced score reporting
Correct answer: Immediate feedback that guides instruction
Formative assessments are designed to provide timely feedback that helps teachers adjust instruction and students improve learning.
Question 4: A test developer wants to ensure that items measure abstract reasoning rather than reading ability. This concern relates to:
- Test bias
- Construct-irrelevant variance (Correct answer)
- Item difficulty
- Differential item functioning
Correct answer: Construct-irrelevant variance
Construct-irrelevant variance occurs when factors unrelated to the intended construct (e.g., reading skill) affect test scores.
Question 5: Which assessment format is BEST suited for measuring a student's ability to organize and synthesize information?
- Multiple-choice items
- True/false items
- Extended-response items (Correct answer)
- Matching items
Correct answer: Extended-response items
Extended-response items require students to construct detailed answers, allowing them to demonstrate higher-order thinking like synthesis and organization.
Question 6: In assessment design, 'table of specifications' is primarily used to:
- Set passing scores for the exam
- Ensure proportional coverage of content and cognitive levels (Correct answer)
- Calculate inter-rater reliability
- Determine item difficulty parameters
Correct answer: Ensure proportional coverage of content and cognitive levels
A table of specifications maps assessment items to content standards and cognitive levels to ensure balanced and representative coverage.
Question 7: Which principle of Universal Design for Learning (UDL) is applied when offering assessments in both written and audio formats?
- Multiple means of engagement
- Multiple means of action and expression
- Multiple means of representation (Correct answer)
- Multiple means of assessment
Correct answer: Multiple means of representation
Multiple means of representation provides information in different formats so all learners can access the content being assessed.
Cambium Test Assessment Design 3
Which type of validity evidence examines whether an assessment's content accurately represents the domain being measured?