Bluebook SAT Test Evaluating Statistical Claims: Observational Studies and Experiments 10 — Questions and Answers
Question 1: A study randomly assigns 200 adults to either a daily walking program or a sedentary control group for 8 weeks. The walking group shows significantly lower blood pressure. Which conclusion is best supported?
- Daily walking appears to cause a reduction in blood pressure based on the randomized experiment. (Correct answer)
- People who walk daily will always have lower blood pressure than those who are sedentary.
- The results can be applied to all adult populations worldwide.
- The reduction in blood pressure is due to placebo effects.
Correct answer: Daily walking appears to cause a reduction in blood pressure based on the randomized experiment.
Random assignment in a controlled experiment supports causal conclusions about the effect of walking on blood pressure within the study population.
Question 2: A journalist reports that cities with more bicycle lanes have fewer traffic fatalities per capita. The journalist concludes that adding bicycle lanes reduces traffic deaths. What is the most significant flaw in this reasoning?
- The data are observational; other differences between cities (e.g., population density, traffic laws) could explain the relationship. (Correct answer)
- The journalist should have counted bicycle lanes per resident rather than total lanes.
- Traffic fatality data is not a reliable measure.
- The study should have been conducted over a longer period.
Correct answer: The data are observational; other differences between cities (e.g., population density, traffic laws) could explain the relationship.
Without controlling for other city-level differences, the correlation between bicycle lanes and lower fatalities may reflect confounding variables rather than a causal effect of the lanes.
Question 3: Researchers randomly select 500 adults from a national registry, then randomly assign half to a new sleep therapy and half to standard care. The therapy group shows a significant improvement in sleep quality. To which group can the results be most validly generalized?
- Adults similar to those in the national registry from which the sample was drawn (Correct answer)
- All adults worldwide with sleep problems
- Only the 500 participants in the study
- All adults who voluntarily seek sleep therapy
Correct answer: Adults similar to those in the national registry from which the sample was drawn
The random selection from a national registry allows generalization to the population represented by that registry; random assignment supports causal conclusions.
Question 4: A researcher finds that students who participate in extracurricular activities have higher graduation rates than those who do not. The researcher claims participation in extracurriculars causes higher graduation rates. What is the most important limitation of this claim?
- Students who participate in extracurriculars may differ from non-participants in motivation, family support, or other factors that also affect graduation. (Correct answer)
- The study did not control for the type of extracurricular activity.
- Graduation rates are not a valid outcome measure.
- The sample of students was too small to draw conclusions.
Correct answer: Students who participate in extracurriculars may differ from non-participants in motivation, family support, or other factors that also affect graduation.
Participation in extracurriculars is self-selected; students who join activities may already have characteristics (higher motivation, better support) that predict graduation regardless of participation.
Question 5: A well-designed randomized controlled experiment finds that a specific tutoring program significantly raises math scores compared to a control group. Which of the following would be the most appropriate conclusion?
- The tutoring program caused an increase in math scores for participants in this study. (Correct answer)
- All students will improve their math scores if they use this tutoring program.
- The tutoring program is the best math intervention ever designed.
- Math scores improve whenever students receive any form of additional instruction.
Correct answer: The tutoring program caused an increase in math scores for participants in this study.
A randomized experiment supports a causal claim within the study population, but generalizability and superiority over other programs require additional evidence.
Question 6: A public health report notes that counties with higher rates of fast food restaurant density have higher obesity rates. An advocacy group concludes that fast food restaurants cause obesity. What is the primary weakness in this conclusion?
- The county-level association is observational and may reflect socioeconomic or cultural confounders rather than a direct causal effect. (Correct answer)
- The study measured the wrong type of restaurant.
- The study should have used individual-level data.
- Obesity rates are not accurately measured at the county level.
Correct answer: The county-level association is observational and may reflect socioeconomic or cultural confounders rather than a direct causal effect.
County-level observational data cannot establish causation; wealthier counties may have fewer fast food restaurants and also lower obesity rates for unrelated reasons.
Question 7: A study randomly assigns 100 participants to write in a gratitude journal daily and 100 to write a neutral diary for 6 weeks, then measures happiness. The gratitude group scores significantly higher. What is the MOST valid conclusion?
- The gratitude journaling practice caused higher happiness scores in this experiment. (Correct answer)
- Everyone who keeps a gratitude journal will become happier.
- Neutral diary writing is harmful to well-being.
- The results would hold for any journaling format.
Correct answer: The gratitude journaling practice caused higher happiness scores in this experiment.
Random assignment allows a causal conclusion that the gratitude journaling caused higher happiness scores within this experimental sample.
Bluebook SAT Test Evaluating Statistical Claims: Observational Studies and Experiments 10
A study randomly assigns 200 adults to either a daily walking program or a sedentary control group for 8 weeks.
The walking group shows significantly lower blood pressure.
Which conclusion is best supported?