Evaluations Flashcards

In FANZCA examination policy, what is the term for the process by which examiners review and discard poorly performing items before calculating final candidate scores?

Answer: Item analysis and banking

Item analysis identifies and banks or discards questions with poor discrimination or unexpected difficulty before final score calculation.

A fellowship candidate is asked: 'What would you do if you arrived at an emergency and found the anaesthetic machine had failed?' This question primarily evaluates which competency?

Answer: Crisis resource management and adaptability

Questions about equipment failure scenarios assess crisis resource management — prioritising patient safety, improvising, and leading under stress.

Which feature of the FANZCA written examination increases construct validity by reducing the effect of test-wiseness on candidate scores?

Answer: Avoiding implausible distractors and all-of-the-above options

Removing implausible distractors and 'all of the above' prevents test-wise candidates from scoring via elimination rather than knowledge.

During a FANZCA structured viva, an examiner asks increasingly probing follow-up questions after each answer. What is the primary educational purpose of this technique?

Answer: To explore the depth and limits of a candidate's knowledge

Progressive probing reveals how deeply a candidate understands a concept by pushing beyond surface recall to mechanism, application, and exception.

A FANZCA candidate correctly describes neostigmine's mechanism but states an incorrect maximum dose. How should this response be evaluated?

Answer: Partial credit — mechanism correct, factual error noted

FANZCA rubrics typically award partial credit, recognising correct conceptual understanding while noting factual errors that would need correction in practice.

Which evaluation design is most appropriate for assessing whether the FANZCA examination predicts long-term clinical performance of fellows?

Answer: Predictive validity study with longitudinal follow-up

Predictive validity is assessed by tracking whether examination scores correlate with future clinical performance outcomes over time.

In the context of FANZCA OSCEs, which approach best mitigates the halo effect where one strong performance biases overall candidate scores?

Answer: Rotating different examiners across stations with independent scoring

Using independent examiners at each OSCE station prevents performance on one station from influencing judgments at subsequent stations.