CPO Research Methods & Evidence-Based Practice 3 — Questions and Answers
Question 1: A researcher reports a 'p-value of 0.03' for a new UV disinfection study. What does this indicate?
- 3% of pools in the study failed
- There is a 3% probability the results occurred by chance (Correct answer)
- The UV system reduced pathogens by 3%
- The study was 3% complete
Correct answer: There is a 3% probability the results occurred by chance
A p-value of 0.03 means there is only a 3% probability that the observed difference between groups occurred by random chance, supporting the study's conclusion.
Question 2: When applying evidence-based practice to pool operations, the CPO should FIRST:
- Adopt the newest technology available
- Identify the specific operational question or problem (Correct answer)
- Consult the most experienced operator nearby
- Purchase the product with the highest sales volume
Correct answer: Identify the specific operational question or problem
Evidence-based practice begins with clearly defining the clinical or operational question before searching for and evaluating relevant evidence.
Question 3: A meta-analysis on chloramine formation combines data from 15 different pool studies. What is the key advantage of this research method?
- It is faster to conduct than a single study
- It provides greater statistical power by pooling large datasets (Correct answer)
- It eliminates the need for water chemistry testing
- It requires only one facility to participate
Correct answer: It provides greater statistical power by pooling large datasets
Meta-analysis pools data from multiple studies, dramatically increasing sample size and statistical power, which produces more precise and reliable estimates of treatment effects.
Question 4: Which research design would BEST determine whether a rise in recreational water illnesses (RWIs) at a facility correlates with bather load?
- In-vitro laboratory experiment
- Prospective cohort study tracking illness rates and attendance (Correct answer)
- Case study of one ill swimmer
- Expert panel discussion
Correct answer: Prospective cohort study tracking illness rates and attendance
A prospective cohort study follows groups over time and can identify associations between bather load (exposure) and illness rates (outcome).
Question 5: A CPO finds two conflicting studies about optimal pH range for chlorine effectiveness. The BEST next step is to:
- Ignore both and rely on the chemical supplier
- Review both studies' methodology and look for systematic reviews (Correct answer)
- Pick the study with the more appealing conclusion
- Average the two recommended pH ranges together
Correct answer: Review both studies' methodology and look for systematic reviews
Evaluating methodology quality and seeking systematic reviews that synthesize multiple studies provides the highest-quality evidence to resolve conflicting findings.
Question 6: In research on pool water quality, a 'control group' refers to:
- Operators who control the chemical feed systems
- A group that does not receive the treatment being tested (Correct answer)
- The group with the strictest water chemistry standards
- Regulators who control pool licensing
Correct answer: A group that does not receive the treatment being tested
A control group is not exposed to the intervention being tested, providing a baseline for comparison to determine the true effect of the treatment.
Question 7: Which scenario represents a CONFLICT OF INTEREST that should make a CPO cautious about a published study?
- The study was conducted at a public university
- The study was entirely funded by the manufacturer of the tested product (Correct answer)
- The study was peer-reviewed by three independent experts
- The study was replicated at five different facilities
Correct answer: The study was entirely funded by the manufacturer of the tested product
Manufacturer-funded studies may have financial bias in design, analysis, or reporting, making independent replication and third-party peer review especially important.
CPO Research Methods & Evidence-Based Practice 3
A researcher reports a 'p-value of 0.03' for a new UV disinfection study.
What does this indicate?