FACRRM Assessment and Evaluation 3 — Questions and Answers
Question 1: A rural health team conducts a 360-degree assessment of a GP registrar. Which component distinguishes 360-degree feedback from standard supervisor assessment?
- It uses standardised written examinations
- It incorporates structured observation of clinical procedures
- It collects feedback from multiple rater groups including patients and colleagues (Correct answer)
- It measures competency against national benchmark scores
Correct answer: It collects feedback from multiple rater groups including patients and colleagues
360-degree (multi-source) feedback systematically gathers input from supervisors, peers, nurses, administrative staff, and patients to provide a comprehensive performance picture.
Question 2: In interpreting a systematic review of rural mental health interventions, a clinician notes significant heterogeneity (I² = 78%). What does this imply?
- Results are highly consistent and pooling is appropriate
- The studies are highly variable and a pooled estimate should be interpreted cautiously (Correct answer)
- The sample size is too small for meta-analysis
- Publication bias is definitively present
Correct answer: The studies are highly variable and a pooled estimate should be interpreted cautiously
An I² of 78% indicates substantial between-study variability; the pooled effect estimate may not be reliable and the sources of heterogeneity should be explored.
Question 3: A remote community undergoes a health impact assessment (HIA) before construction of a new road. Which stage involves predicting the likely health effects on the population?
- Screening
- Scoping
- Appraisal (Correct answer)
- Monitoring
Correct answer: Appraisal
The appraisal stage of HIA involves systematically identifying and predicting potential health effects of the proposed project on the community.
Question 4: A GP uses the Mini-CEX (Mini Clinical Evaluation Exercise) to assess a registrar's consultation skills. What is the primary advantage of this tool over written assessments?
- It is more reliable because it uses a standardised MCQ format
- It directly observes performance in real clinical encounters (Correct answer)
- It eliminates assessor subjectivity through automated scoring
- It requires less time than OSCE stations
Correct answer: It directly observes performance in real clinical encounters
The Mini-CEX assesses authentic workplace performance by directly observing the learner in a real clinical encounter, capturing competencies that written tests cannot measure.
Question 5: When calculating the number needed to treat (NNT) from a clinical trial, which data element is essential?
- Relative risk ratio alone
- Absolute risk reduction between treatment and control groups (Correct answer)
- Hazard ratio from survival analysis
- Odds ratio from logistic regression
Correct answer: Absolute risk reduction between treatment and control groups
NNT = 1 / Absolute Risk Reduction; the ARR (difference in event rates between control and treatment groups) is the required input.
Question 6: A rural hospital quality improvement team uses a run chart to monitor monthly hand-hygiene compliance. What pattern on a run chart signals a non-random improvement?
- Any single point above the mean
- Six or more consecutive points on the same side of the median (Correct answer)
- Two consecutive points below the lower control limit
- Random scatter around the centre line
Correct answer: Six or more consecutive points on the same side of the median
A run of six or more consecutive points on one side of the median is a recognized signal of a non-random shift in process performance on a run chart.
Question 7: A remote area health service evaluates a prevention program using the RE-AIM framework. Which dimension assesses the proportion of the target population that participates in the program?
- Reach (Correct answer)
- Effectiveness
- Adoption
- Implementation
Correct answer: Reach
Reach in the RE-AIM framework refers to the proportion and representativeness of individuals in the target population who participate in the intervention.
FACRRM Assessment and Evaluation 3
A rural health team conducts a 360-degree assessment of a GP registrar.
Which component distinguishes 360-degree feedback from standard supervisor assessment?