DHA Quality Improvement & Audits 2 — Questions and Answers
Question 1: In healthcare quality improvement, what is the purpose of a 'run chart' in tracking quality metrics over time?
- To compare two groups in a randomized trial
- To display data over time and identify trends, shifts, or unusual patterns in a process (Correct answer)
- To calculate the statistical significance of a quality intervention
- To map patient flow through a department
Correct answer: To display data over time and identify trends, shifts, or unusual patterns in a process
A run chart displays a quality metric plotted over time (y-axis = metric, x-axis = time). It helps identify trends (gradual rise or fall), shifts (sustained change in level), and special cause variation. Run charts are a simple but powerful quality improvement tool preceding more complex statistical process control (SPC) charts.
Run chart interpretation: Trend = 6+ consecutive points consistently rising or falling (excludes repeats); Shift = 8+ consecutive points above or below the median; Astronomical point = obviously unusual data point. Run charts are used before and after quality interventions to demonstrate improvement. Compared to SPC (control charts): run charts have no control limits, easier to construct; control charts (p-charts, u-charts, X-bar R charts) provide statistical process control limits. DHA quality departments use run charts to monitor KPIs like HCAI rates, hand hygiene compliance, medication error rates.
Question 2: A hospital quality team is investigating a high rate of catheter-associated urinary tract infections (CAUTI) on a medical ward. Which quality improvement methodology uses the structured approach of 'Define, Measure, Analyze, Improve, Control'?
- Lean management
- PDSA (Plan-Do-Study-Act)
- Six Sigma DMAIC (Correct answer)
- Root Cause Analysis
Correct answer: Six Sigma DMAIC
The Six Sigma DMAIC methodology is specifically structured as Define (problem statement), Measure (baseline data), Analyze (root causes), Improve (interventions), Control (sustain gains). It is data-driven and uses statistical methods to reduce variation and defects — appropriate for complex quality problems like CAUTI.
DMAIC for CAUTI project: Define (CAUTI rate, patient harm, cost); Measure (baseline CAUTI rate per 1000 catheter days, process metrics like catheter insertion documentation); Analyze (fishbone diagram — 5 Whys: unnecessary catheter use, improper technique, delayed removal, absence of daily review); Improve (implement catheter bundle, daily necessity review, nurse-driven removal protocol); Control (audit tool, run chart monitoring, champion accountability). Compare with PDSA: iterative small-cycle testing — less structured but faster for simple problems. Both used in DHA quality programs.
Question 3: In the context of hospital accreditation, what does the abbreviation 'KPI' stand for and how is it used?
- Knowledge Processing Indicator — a measure of staff education levels
- Key Performance Indicator — a measurable value demonstrating how effectively an organization is achieving key objectives (Correct answer)
- Knowledge and Practice Initiative — an accreditation program for nurses
- Known Patient Incidents — a reporting system for adverse events
Correct answer: Key Performance Indicator — a measurable value demonstrating how effectively an organization is achieving key objectives
KPIs (Key Performance Indicators) are specific, measurable metrics that track progress toward organizational goals. In healthcare, KPIs include clinical quality indicators (infection rates, mortality), patient satisfaction scores, operational metrics (bed occupancy, ALOS), and safety indicators (medication errors, falls). DHA and JCI require facilities to define, track, and report KPIs.
Healthcare KPI categories: Clinical quality (CLABSI rate per 1000 CVC days, SSI rate, 30-day readmission rate, mortality index); Patient safety (medication error rate, falls per 1000 patient days, HAPU rate); Patient experience (HCAHPS satisfaction scores, complaint rates, wait times); Operational efficiency (ALOS, bed occupancy, OR utilization, ED length of stay); Financial (cost per case, revenue cycle metrics). DHA requires reporting of specific KPIs. SMART KPIs: Specific, Measurable, Achievable, Relevant, Time-bound. Benchmarking against national/international standards identifies performance gaps.
Question 4: What is the difference between a 'prospective' and 'retrospective' clinical audit?
- Prospective audit is conducted in developed countries; retrospective in developing countries
- Prospective audit collects data on current/future practice in real time; retrospective audit reviews past records to assess past practice (Correct answer)
- Prospective audit costs more but provides no additional value
- Retrospective audit is always more accurate than prospective audit
Correct answer: Prospective audit collects data on current/future practice in real time; retrospective audit reviews past records to assess past practice
Prospective audit: data collected in real time as care is delivered, allowing immediate feedback and correction — more resource-intensive but catches errors in progress. Retrospective audit: reviews past medical records to assess how care was delivered — easier to conduct but cannot change what already happened.
Audit timing: Prospective: concurrent with care delivery → can intervene in real time (e.g., auditing antibiotic prescriptions daily → immediate feedback to prescribers); ideal for high-risk, high-volume processes. Retrospective: review completed records → identifies patterns and trends; cannot change outcomes already occurred; useful for benchmarking and identifying systemic issues. Both types are part of the clinical audit cycle. Example: retrospective audit of CAUTI rates for last quarter identifies baseline → prospective audit during bundle implementation tracks compliance → re-audit confirms improvement. DHA quality standards expect both audit types.
Question 5: A hospital wishes to reduce its surgical site infection (SSI) rate. They implement a bundle intervention (pre-op antibiotic timing, glucose control, normothermia, chlorhexidine wash). After 6 months, SSI rates fall significantly. To confirm this is a real improvement and not random variation, which statistical tool is most appropriate?
- Descriptive statistics only (mean and standard deviation)
- Statistical process control (SPC) chart with control limits (Correct answer)
- A case report describing one improved patient
- Fisher's exact test for two proportions
Correct answer: Statistical process control (SPC) chart with control limits
Statistical process control (SPC) charts — specifically Shewhart control charts — distinguish between common cause variation (normal random variation within a stable process) and special cause variation (real change in process performance). If post-intervention data points fall outside control limits or show non-random patterns, the improvement is statistically significant.
SPC charts: P-chart (proportions — SSI rate as %), U-chart (counts — infections per procedure), X-bar R chart (continuous data). Control limits: mean ± 3 standard deviations → 99.73% of points within limits in stable process. Special cause signals: point outside control limit, 8+ points same side of centerline, 6+ consecutive trend, 14+ alternating. Post-bundle SSI: if points move below lower control limit = real improvement (special cause, positive). SPC is preferred over one-time statistical tests in QI because processes are monitored continuously. DHA quality teams use SPC alongside run charts for KPI monitoring.
Question 6: In the PDSA (Plan-Do-Study-Act) quality improvement cycle, what should happen in the 'Act' phase?
- Collect initial baseline data on the problem
- Implement the intervention on a small scale
- Analyze data and compare results to predictions
- Decide to adopt, adapt, or abandon the change based on study results, then plan the next cycle (Correct answer)
Correct answer: Decide to adopt, adapt, or abandon the change based on study results, then plan the next cycle
In the Act phase of PDSA: based on the Study phase results, the team decides whether to: adopt the change (if successful), adapt it (modify and run another PDSA cycle), or abandon it (if unsuccessful). The Act phase feeds into the next Plan phase — making PDSA a continuous improvement cycle.
PDSA cycle: Plan (identify improvement opportunity, set aim, plan test of change, predict outcome); Do (implement change on small scale, collect data, document observations); Study (analyze data vs. predictions, identify what worked/didn't); Act (decide: adopt/adapt/abandon, plan next cycle). PDSA for SSI: Plan (hypothesis: pre-op chlorhexidine wash reduces SSI by 30%); Do (implement in 2 surgical wards for 1 month); Study (compare SSI rates before/after, check compliance); Act (if successful — adopt hospital-wide; if partial — adapt protocol; if no effect — abandon, try different intervention). Multiple PDSA cycles create iterative improvement.
DHA Quality Improvement & Audits 2
In healthcare quality improvement, what is the purpose of a 'run chart' in tracking quality metrics over time?