CNE Assessment 4 — Questions and Answers
Question 1: A nurse educator suspects that a clinical performance evaluation tool lacks inter-rater reliability. What is the BEST first step to address this issue?
- Remove the tool and use subjective narrative evaluations instead
- Conduct calibration training sessions for all evaluators using the tool (Correct answer)
- Reduce the number of performance criteria on the tool
- Switch to a self-assessment model
Correct answer: Conduct calibration training sessions for all evaluators using the tool
Evaluator calibration training aligns rater interpretations of criteria, directly improving inter-rater reliability of the assessment instrument.
Question 2: Which assessment strategy is MOST congruent with assessing students at the 'synthesis' level of Bloom's original taxonomy?
- Identifying normal lab values from a list
- Selecting the correct definition of a nursing diagnosis
- Constructing an individualized care plan for a complex patient (Correct answer)
- Recalling the steps of sterile dressing change
Correct answer: Constructing an individualized care plan for a complex patient
Synthesis requires students to combine elements into a new whole, such as constructing a unique care plan tailored to a specific patient.
Question 3: When evaluating a student's clinical performance using anecdotal notes, the CNE should ensure notes are:
- Generalized summaries of overall student attitude
- Specific, objective, and dated behavioral observations (Correct answer)
- Shared with all faculty before the final evaluation meeting
- Based solely on the most recent clinical experience
Correct answer: Specific, objective, and dated behavioral observations
Effective anecdotal notes document specific, observable behaviors with date and context, providing objective evidence for summative clinical evaluation.
Question 4: A high-stakes nursing examination has a point biserial correlation of 0.05 for one item. This indicates the item:
- Strongly discriminates between high and low performers
- Has little to no relationship between getting the item right and overall test performance (Correct answer)
- Should be weighted more heavily in scoring
- Meets acceptable psychometric standards for inclusion
Correct answer: Has little to no relationship between getting the item right and overall test performance
A point biserial correlation near zero indicates the item does not differentiate between students who know the material and those who do not.
Question 5: Which of the following scenarios represents a construct-irrelevant variance threat to assessment validity?
- A pharmacology exam that includes too few drug calculation items
- A reading-heavy exam that disadvantages students with limited English proficiency when measuring clinical reasoning (Correct answer)
- An exam where all items come from only one textbook chapter
- A rubric that lacks descriptors for each performance level
Correct answer: A reading-heavy exam that disadvantages students with limited English proficiency when measuring clinical reasoning
Construct-irrelevant variance occurs when factors unrelated to the intended construct (e.g., reading ability vs. clinical reasoning) affect scores.
Question 6: A nurse educator uses think-aloud protocols during simulation to assess student clinical reasoning. Which type of assessment does this represent?
- Norm-referenced assessment
- Process-oriented assessment (Correct answer)
- Summative assessment
- Standardized testing
Correct answer: Process-oriented assessment
Think-aloud protocols capture students' cognitive processes as they unfold, making this a process-oriented assessment focused on reasoning, not just outcomes.
Question 7: When establishing a passing standard for a clinical competency exam using the modified Angoff method, what do expert judges estimate?
- The average score of the current student cohort
- The probability that a minimally competent candidate would answer each item correctly (Correct answer)
- The difficulty index of each item based on past administrations
- The time needed for students to complete the examination
Correct answer: The probability that a minimally competent candidate would answer each item correctly
In the Angoff method, judges estimate the proportion of minimally competent examinees expected to answer each item correctly, and these estimates are averaged to set the passing standard.
CNE Assessment 4
A nurse educator suspects that a clinical performance evaluation tool lacks inter-rater reliability.
What is the BEST first step to address this issue?