CFD Assessment & Evaluation Methods 2 — Questions and Answers
Question 1: A faculty developer wants to measure whether a workshop actually changed teaching behaviors in the classroom. Which evaluation level in Kirkpatrick's model addresses this?
- Level 1 – Reaction
- Level 2 – Learning
- Level 3 – Behavior (Correct answer)
- Level 4 – Results
Correct answer: Level 3 – Behavior
Kirkpatrick's Level 3 (Behavior) assesses whether participants transfer learning into observable changes in job performance.
Question 2: Which assessment strategy is BEST suited for evaluating higher-order thinking skills such as synthesis and evaluation?
- Multiple-choice tests
- True/false quizzes
- Performance-based tasks (Correct answer)
- Attendance records
Correct answer: Performance-based tasks
Performance-based tasks require students to apply, synthesize, and evaluate knowledge, aligning with higher-order Bloom's taxonomy levels.
Question 3: An instructor notices that exam scores cluster near 95% for most students. This likely indicates a problem with:
- Reliability
- Ceiling effect (Correct answer)
- Floor effect
- Content validity
Correct answer: Ceiling effect
A ceiling effect occurs when an assessment is too easy, causing most scores to cluster at the top and limiting differentiation.
Question 4: What does 'inter-rater reliability' measure in the context of assessment?
- Consistency of scores across different test forms
- Agreement between two or more graders scoring the same work (Correct answer)
- Correlation between pre- and post-test scores
- Stability of scores over time
Correct answer: Agreement between two or more graders scoring the same work
Inter-rater reliability measures the degree to which independent scorers assign the same scores to the same student work.
Question 5: A faculty developer recommends embedding low-stakes quizzes throughout a semester rather than relying on a single final exam. This strategy leverages which learning principle?
- Massed practice
- Spaced retrieval practice (Correct answer)
- Interleaving concepts only at end-of-term
- Blocked practice
Correct answer: Spaced retrieval practice
Spaced retrieval practice (the testing effect) shows that frequent, distributed low-stakes quizzes strengthen long-term retention.
Question 6: Which type of validity evidence confirms that an assessment covers the full range of content in a course's learning objectives?
- Predictive validity
- Construct validity
- Content validity (Correct answer)
- Concurrent validity
Correct answer: Content validity
Content validity ensures the assessment adequately samples the full domain of knowledge and skills defined by the course objectives.
Question 7: A faculty developer reviews a rubric where the descriptors for 'Satisfactory' and 'Excellent' overlap significantly. The BEST fix is to:
- Add more performance levels to the rubric
- Rewrite descriptors to make distinctions clear and observable (Correct answer)
- Remove the 'Satisfactory' level entirely
- Switch from a rubric to a checklist
Correct answer: Rewrite descriptors to make distinctions clear and observable
Overlapping descriptors undermine reliability; rewriting them with precise, observable criteria clarifies distinctions between performance levels.
CFD Assessment & Evaluation Methods 2
A faculty developer wants to measure whether a workshop actually changed teaching behaviors in the classroom.
Which evaluation level in Kirkpatrick's model addresses this?