Evaluation and Feedback Flashcards

A program director wants to track individual student progress across multiple OSCE sittings over time. Which approach BEST supports this longitudinal evaluation goal?

Answer: Use a portfolio of OSCE scores with narrative feedback collected at multiple time points

A longitudinal portfolio approach captures developmental trajectories and allows meaningful tracking of competence growth over time.

Which scenario illustrates a 'leniency bias' in OSCE examiner scoring?

Answer: An examiner consistently scores all students higher than the anchor descriptors justify

Leniency bias occurs when an examiner systematically awards inflated scores relative to the performance standard, reducing the exam's discriminability.

A feedback recipient asks, 'What is the one thing I should focus on improving?' This reflects which principle of effective feedback delivery?

Answer: Prioritizing the most impactful action point to avoid cognitive overload

Prioritizing one key improvement prevents feedback overload and makes it more likely the learner will act on the advice.

An OSCE station uses a 'must-pass' item — a critical action that, if omitted, results in automatic failure of the station regardless of total score. Which patient safety scenario BEST justifies a must-pass item?

Answer: Failing to check for penicillin allergy before prescribing amoxicillin

Must-pass items are reserved for actions with direct patient safety implications, such as allergy checks before prescribing potentially fatal medications.

A student completed their OSCE six months ago and has not received any feedback. What is the PRIMARY concern with this delay?

Answer: The student may have forgotten the encounter details, rendering feedback less actionable

The educational value of feedback diminishes significantly when delivered long after the performance, because the learner can no longer recall the specific behaviors to change.

When designing an OSCE blueprint, which psychometric principle guides the selection of how many stations to include?

Answer: More stations increase content validity and improve reliability by sampling broadly

Reliability improves with more stations because broader sampling reduces the influence of any single station's variability on the overall score.

Which of the following BEST describes 'feed-forward' as a component of the feedback process?

Answer: Providing guidance on future actions the learner should take to improve

Feed-forward focuses on prospective guidance — what the learner should do differently next time — making feedback actionable rather than merely evaluative.