Evaluation and Feedback Flashcards

A student receives written OSCE feedback stating: 'Your examination technique was adequate.' Why is this feedback considered poor quality?

Answer: It lacks specificity, making it impossible to identify what to maintain or improve

Feedback must be specific enough for the learner to identify which behaviors to replicate or change; 'adequate' provides no actionable detail.

An OSCE examiner uses the Angoff method to set the pass mark. What does this involve?

Answer: Expert judges estimating the probability that a minimally competent candidate would answer each item correctly

The Angoff method asks expert judges to estimate, item by item, what proportion of borderline-competent candidates would succeed, then aggregates these probabilities as the pass mark.

A student passes all individual OSCE stations but fails the overall examination. Which scoring policy makes this outcome possible?

Answer: Conjunctive scoring that requires meeting a minimum threshold on every station

Conjunctive scoring requires candidates to meet a minimum score on each station; failure on any station can result in overall failure even if other stations were passed.

A faculty developer wants to improve the quality of examiner feedback during OSCEs. Which training strategy has the STRONGEST evidence for improving feedback quality?

Answer: Having examiners practice giving feedback with video review and peer critique

Deliberate practice with video review and peer critique develops feedback skills more effectively than passive exposure to theory.

In an OSCE evaluation, 'content validity' refers to:

Answer: The degree to which the stations represent the breadth of the intended clinical competencies

Content validity ensures the station sample adequately represents the full domain of competencies the exam is designed to assess.

A student who failed an OSCE requests remediation. Which remediation plan is MOST likely to lead to genuine competency improvement?

Answer: Targeted practice on the specific skills that failed, with structured feedback from a supervisor

Effective remediation targets the specific deficit with deliberate practice and feedback, not passive review or unguided repetition.

Which statement BEST explains why peer feedback in OSCE practice sessions can be valuable?

Answer: Giving and receiving peer feedback develops self-assessment skills and deepens understanding of performance criteria

The process of evaluating peers requires learners to internalize assessment criteria, which simultaneously improves their self-assessment capacity.