CHSE Assessment and Evaluation Methods 2

Question 1

Which assessment tool is MOST appropriate for evaluating a learner's real-time clinical decision-making during a high-fidelity simulation?

Accepted Answer

Direct observation checklist with behavioral anchors

Answer

Written multiple-choice examination

Answer

Post-simulation written reflective essay

Answer

Peer-review portfolio assessment

Question 2

In the context of simulation-based assessment, what does 'consequential validity' refer to?

Accepted Answer

The intended and unintended effects of assessment decisions on learners and programs

Answer

The accuracy of scoring rubrics

Answer

The degree to which an assessment predicts future performance

Answer

The consistency of scores across multiple raters

Question 3

A simulation educator wants to ensure that an OSCE station accurately measures IV insertion technique. Which type of validity is the PRIMARY concern?

Accepted Answer

Content validity

Answer

Predictive validity

Answer

Construct validity

Answer

Concurrent validity

Question 4

Which of the following BEST describes formative assessment in simulation education?

Accepted Answer

Ongoing feedback during learning designed to improve performance

Answer

A high-stakes evaluation used to determine competency for promotion

Answer

A final summative judgment at the end of a training program

Answer

A standardized test administered once per academic year

Question 5

When evaluating inter-rater reliability in simulation assessments, a kappa coefficient of 0.75 is obtained. How should this value be interpreted?

Accepted Answer

Substantial agreement, generally acceptable for most assessments

Answer

Poor agreement, requiring immediate rubric revision

Answer

Slight agreement, suggesting rater training is needed

Answer

Perfect agreement, no further calibration needed

Question 6

A simulation program uses the same test both before and after a training intervention to measure learning gains. This approach is BEST described as:

Accepted Answer

Pre-test/post-test design

Answer

Concurrent validity testing

Answer

Criterion-referenced evaluation

Answer

Norm-referenced assessment

Question 7

Which evaluation model is MOST commonly referenced when assessing the overall effectiveness of a simulation training program across multiple levels, including reaction, learning, behavior, and results?

Accepted Answer

Kirkpatrick's Four-Level Model

Answer

Miller's Pyramid

Answer

Bloom's Taxonomy

Answer

Kolb's Experiential Learning Cycle