OSCE Evaluation and Feedback 2 — Questions and Answers
Question 1: A student receives feedback that their history-taking was 'too rushed.' Which response best demonstrates effective uptake of formative feedback?
- Argue that the time limit was too short
- Reflect on pacing, then practice with a timer during mock OSCEs (Correct answer)
- Ask the examiner to repeat the same station immediately
- Record the feedback and take no further action
Correct answer: Reflect on pacing, then practice with a timer during mock OSCEs
Effective feedback uptake involves reflection followed by deliberate practice to address the identified gap.
Question 2: In an OSCE, the checklist item reads 'Washes hands before examination.' A student washes hands but only after touching the patient. How should an examiner score this?
- Mark as complete because hand hygiene was performed
- Mark as not performed because timing was incorrect (Correct answer)
- Award half marks for partial completion
- Ask the student to repeat the action
Correct answer: Mark as not performed because timing was incorrect
Checklists are scored based on whether the action was performed correctly and at the appropriate time, not merely whether it occurred.
Question 3: Which of the following BEST describes the purpose of a structured debrief immediately after an OSCE station?
- To assign final grades before the student leaves the room
- To allow the examiner to vent frustration about errors
- To reinforce learning by discussing performance while it is still salient (Correct answer)
- To standardize scores across different examiners
Correct answer: To reinforce learning by discussing performance while it is still salient
Immediate structured debriefs capitalize on the learner's fresh memory of the encounter to maximize educational impact.
Question 4: A global rating scale asks an examiner to rate a student's communication skills from 1–5. This type of scale is most susceptible to which rating error?
- Ceiling effect only
- Halo effect, where overall impression biases individual domain scores (Correct answer)
- Floor effect only
- Interrater reliability error exclusively
Correct answer: Halo effect, where overall impression biases individual domain scores
Global rating scales are vulnerable to the halo effect, where a strong or weak performance in one area skews ratings in unrelated domains.
Question 5: When calibrating examiners before an OSCE, the MAIN goal is to:
- Reduce the number of checklist items to save time
- Ensure all examiners apply the same standard to student performance (Correct answer)
- Teach examiners how to perform clinical skills themselves
- Eliminate the need for a marking scheme
Correct answer: Ensure all examiners apply the same standard to student performance
Examiner calibration aligns scoring standards, improving interrater reliability and fairness across stations.
Question 6: A student scores 60% on a borderline OSCE station. The borderline group method places the pass mark at 62%. What is the correct outcome?
- The student passes because they are close to the pass mark
- The student fails because their score is below the pass mark (Correct answer)
- The pass mark should be lowered to accommodate the student
- The station should be discarded as too difficult
Correct answer: The student fails because their score is below the pass mark
The borderline group method sets the pass mark based on borderline performers; a score below that mark results in a fail regardless of proximity.
Question 7: Which feedback model specifically asks the learner to self-assess before the supervisor provides observations?
- The Feedback Sandwich
- Pendleton's Rules (Correct answer)
- SMART goal setting
- The SPIKES protocol
Correct answer: Pendleton's Rules
Pendleton's Rules begin by inviting the learner to identify what went well before the observer adds their perspective, encouraging self-reflection.
A student receives feedback that their history-taking was 'too rushed.' Which response best demonstrates effective uptake of formative feedback?