Bluebook SAT Test Evaluating Statistical Claims: Observational Studies and Experiments 15

Question 1

Researchers conduct an observational study and find that adults who take multivitamins have lower rates of chronic illness. A supplement company advertises that multivitamins prevent chronic illness. What is the most critical flaw in this advertising claim?

Accepted Answer

Adults who take multivitamins may also engage in many other healthy behaviors, making it impossible to isolate the effect of vitamins alone.

Answer

People who take multivitamins are likely health-conscious in many ways, creating confounding between vitamin use and other health behaviors.

Question 2

A study randomly assigns 200 patients to either a new drug or a placebo and finds that the drug group has significantly fewer hospital readmissions. A hospital administrator wants to use this result to project cost savings for all patients. What concern is most valid?

Accepted Answer

The study sample may not be representative of all patients, limiting the generalizability of cost savings estimates.

Answer

While random assignment supports the causal effect, projecting to all patients requires that the study sample represent the broader hospital population.

Question 3

An observational study finds that people who attend religious services weekly have lower blood pressure than those who do not. A cardiologist claims that attending religious services reduces blood pressure. What is the most important limitation of this claim?

Accepted Answer

Frequent service attendees may have stronger social support networks and lower stress for reasons unrelated to religious attendance itself.

Answer

Religious service attendance is associated with social connection and community support, which independently lower stress and blood pressure, creating confounding.

Question 4

A research group randomly assigns 50 elementary classrooms to use a new math game software and 50 to use traditional worksheets for one semester. Math test scores are significantly higher in the software group. What is the best causal conclusion?

Accepted Answer

Using the math game software caused higher math scores compared to worksheets in these classrooms.

Answer

Random assignment of classrooms to conditions supports the causal conclusion that the software (vs. worksheets) caused higher scores within this study.

Question 5

A national survey finds that adults who cook at home more often have lower body mass index (BMI) than those who eat out frequently. A health campaign claims: 'Cook at home to lose weight.' What is the primary flaw in this campaign?

Accepted Answer

The survey is observational; people who cook at home may also make healthier food choices and exercise more, making it impossible to isolate cooking's effect.

Answer

Home cooking is correlated with other healthy behaviors; the lower BMI may be due to overall lifestyle differences rather than cooking location alone.

Bluebook SAT Practice Test

Bluebook SAT Practice Test

Bluebook SAT Test Evaluating Statistical Claims: Observational Studies and Experiments 15