Assessment and Evaluation Methods Flashcards

During debriefing, a faculty member notices a learner consistently underestimates her own performance. Which debriefing technique BEST addresses this self-assessment gap?

Answer: Advocacy-inquiry to explore the gap between self-assessment and observed performance

Advocacy-inquiry combines the facilitator's observation with a genuine question, inviting the learner to reflect on and explain the gap in their self-assessment.

A simulation center wishes to compare its trainees' performance against a national benchmark. Which assessment approach is MOST appropriate?

Answer: Norm-referenced assessment using national standardization data

Norm-referenced assessment ranks learner performance relative to a broader reference group, making it suitable for comparison against national benchmarks.

Which statistical measure BEST describes the consistency of an assessment tool when administered on two separate occasions to the same group of learners?

Answer: Test-retest reliability coefficient

Test-retest reliability measures the stability of scores over time when the same instrument is administered twice to the same participants.

In simulation-based assessment, 'deliberate practice' is MOST closely associated with which outcome?

Answer: Repeated, focused practice with immediate feedback to mastery

Deliberate practice involves structured, repetitive practice with targeted feedback aimed at achieving a defined mastery standard.

A residency program implements simulation checkpoints where trainees must meet a minimum performance standard before advancing. This BEST exemplifies:

Answer: Mastery learning with criterion-referenced standards

Mastery learning requires all learners to achieve a predefined criterion before advancement, regardless of how their peers perform.

Which of the following is the PRIMARY limitation of using global rating scales compared to task-specific checklists in simulation assessment?

Answer: Global rating scales may lack the granularity needed to identify specific skill deficits

While global rating scales capture overall performance efficiently, they may miss discrete skill errors that a detailed task checklist would identify.

When a simulation-based assessment is described as 'authentic,' it PRIMARILY means the assessment:

Answer: Reflects real-world tasks and contexts relevant to professional practice

Authentic assessment requires learners to perform tasks that closely mirror actual professional responsibilities and real clinical contexts.