CFD Assessment & Evaluation Methods 4 — Questions and Answers
Question 1: Which of the following BEST describes the purpose of a blueprint (test specification table) in assessment design?
- To define grading curves for the class
- To ensure the test proportionally covers all intended learning objectives (Correct answer)
- To determine the number of extra-credit opportunities
- To schedule assessment dates across the semester
Correct answer: To ensure the test proportionally covers all intended learning objectives
A test blueprint maps items to learning objectives and cognitive levels, ensuring the assessment is balanced and representative of course content.
Question 2: Metacognitive assessment strategies, such as exam wrappers, are designed to help students:
- Study less by identifying only the highest-priority topics
- Reflect on their preparation strategies and performance to improve future studying (Correct answer)
- Compare their scores to classmates for motivation
- Request grade adjustments after exams
Correct answer: Reflect on their preparation strategies and performance to improve future studying
Exam wrappers prompt students to analyze what they did to prepare, what they got wrong, and how to adjust their study strategies going forward.
Question 3: A faculty developer suggests using 'think-aloud protocols' during assessment development. This technique helps identify:
- Whether items are statistically reliable
- How test-takers interpret and process individual items (Correct answer)
- The average completion time for the full test
- Grader bias in holistic scoring
Correct answer: How test-takers interpret and process individual items
Think-aloud protocols reveal students' cognitive processes as they respond to items, exposing ambiguity or misinterpretation in item wording.
Question 4: Which of the following is a hallmark feature of standards-based grading compared to traditional points-based grading?
- Grades are determined solely by test performance
- Grades reflect mastery of specific learning standards rather than point accumulation (Correct answer)
- Extra credit heavily influences final grades
- Attendance and participation dominate the grade calculation
Correct answer: Grades reflect mastery of specific learning standards rather than point accumulation
Standards-based grading ties grades to demonstrated mastery of defined learning outcomes, decoupling them from behaviors like attendance or extra credit.
Question 5: An instructor wants peer assessment to be fair and educationally valuable. The MOST important step is to:
- Assign peer reviews randomly without any criteria
- Train students on the rubric and calibrate ratings before grading (Correct answer)
- Let students choose their own peer reviewers
- Grade peer reviews on effort rather than accuracy
Correct answer: Train students on the rubric and calibrate ratings before grading
Calibrating students to use the rubric consistently ensures peer assessment is reliable and teaches evaluative thinking alongside content.
Question 6: When evaluating faculty development programs, 'return on expectations' (ROE) is considered more practical than ROI (return on investment) because:
- ROI calculations are mathematically impossible in education
- ROE focuses on whether pre-defined stakeholder expectations were met rather than requiring financial conversion of outcomes (Correct answer)
- ROE ignores participant satisfaction entirely
- ROI measures only behavioral change, not financial impact
Correct answer: ROE focuses on whether pre-defined stakeholder expectations were met rather than requiring financial conversion of outcomes
ROE assesses whether the program delivered on stakeholders' stated expectations, which is more feasible than converting educational outcomes into dollar values.
Question 7: A faculty member uses anonymous mid-semester student feedback to adjust instruction before the course ends. This practice is an example of:
- Summative evaluation
- Norm-referenced assessment
- Small Group Instructional Diagnosis (SGID) / midcourse correction (Correct answer)
- Criterion-referenced grading
Correct answer: Small Group Instructional Diagnosis (SGID) / midcourse correction
Mid-semester feedback processes like SGID collect anonymous student input so instructors can make real-time adjustments, a formative evaluation practice.
CFD Assessment & Evaluation Methods 4
Which of the following BEST describes the purpose of a blueprint (test specification table) in assessment design?