CPN Research Methods & Evidence-Based Practice 3 — Questions and Answers
Question 1: A research abstract reports a p-value of 0.03 for a sleep intervention. This means:
- There is a 3% chance the intervention is effective
- There is a 3% probability the results occurred by chance alone (Correct answer)
- 97% of children improved with the intervention
- The study had a 3% error rate
Correct answer: There is a 3% probability the results occurred by chance alone
A p-value of 0.03 means there is only a 3% probability that the observed difference occurred by random chance, indicating statistical significance.
Question 2: When critically appraising a study, 'internal validity' refers to:
- Whether findings apply to children outside the study
- Whether the study measures what it claims to measure (Correct answer)
- The size of the study sample
- The journal's impact factor
Correct answer: Whether the study measures what it claims to measure
Internal validity refers to how well a study is designed to accurately measure the relationship between its variables, free from bias.
Question 3: A nanny finds two studies with contradictory findings on screen time. The BEST next step is to:
- Choose the older study as it has been validated longer
- Look for a systematic review or meta-analysis on the topic (Correct answer)
- Accept both findings as equally valid
- Disregard both studies and use personal experience
Correct answer: Look for a systematic review or meta-analysis on the topic
Systematic reviews and meta-analyses synthesize multiple studies, providing the most comprehensive and reliable answer when individual studies conflict.
Question 4: A study's 'control group' serves the purpose of:
- Receiving the most effective known treatment
- Providing a comparison baseline without the experimental intervention (Correct answer)
- Being monitored more closely than the experimental group
- Ensuring participants meet inclusion criteria
Correct answer: Providing a comparison baseline without the experimental intervention
The control group does not receive the experimental intervention, allowing researchers to isolate the intervention's specific effect.
Question 5: Which statement best describes 'confirmation bias' in evaluating childcare research?
- Preferring studies with larger sample sizes
- Favoring information that confirms pre-existing beliefs (Correct answer)
- Repeating a study to confirm its results
- Requiring multiple sources before accepting a finding
Correct answer: Favoring information that confirms pre-existing beliefs
Confirmation bias is the tendency to seek and favor evidence that supports what one already believes, distorting objective evaluation.
Question 6: In a research report, the 'methods section' primarily describes:
- The study's conclusions and recommendations
- How the study was designed and data were collected (Correct answer)
- A review of prior literature on the topic
- The funding sources for the research
Correct answer: How the study was designed and data were collected
The methods section details study design, participant recruitment, data collection procedures, and analysis approach, enabling replication and critique.
Question 7: An article claims that a new napping schedule 'significantly' improved toddler behavior. As a critical reader, you should first check:
- The author's social media presence
- Whether 'significant' refers to statistical or practical significance (Correct answer)
- The country where the study was conducted
- Whether photographs were included
Correct answer: Whether 'significant' refers to statistical or practical significance
Statistical significance (p-value) and practical significance (effect size/real-world impact) are different; a statistically significant finding may have minimal real-world value.
CPN Research Methods & Evidence-Based Practice 3
A research abstract reports a p-value of 0.03 for a sleep intervention.
This means: