Bluebook SAT Test Evaluating Statistical Claims: Observational Studies and Experiments 4

Question 1

A biology teacher randomly selects 30 students from her class to test a new lab activity, then compares their quiz scores to the remaining students. She finds the selected students score higher. Can she conclude the new lab activity causes higher quiz scores?

Accepted Answer

No, because random selection for one group does not constitute random assignment to treatment and control groups.

Answer

The remaining students are not an equivalent control group; without random assignment, pre-existing differences between groups could explain the score difference.

Question 2

Researchers randomly assign 100 trees in an orchard to receive a new fertilizer and 100 trees to receive standard fertilizer. The treated trees yield 20% more fruit. What is the most appropriate conclusion?

Accepted Answer

The new fertilizer likely causes higher fruit yield in orchards similar to the one studied.

Answer

Random assignment within the orchard supports a causal conclusion limited to orchard conditions similar to those in the study.

Question 3

A university study randomly assigns incoming students to two groups: one receives a financial literacy workshop and one does not. After one year, the workshop group has higher savings rates. Which conclusion is most appropriate?

Accepted Answer

Among students similar to those in this university, attending the workshop likely causes higher savings.

Answer

The random assignment supports a causal conclusion, but it applies to students like those at this university, not necessarily all college students.

Question 4

A study surveys adults about coffee consumption and heart disease risk, finding that higher coffee drinkers have lower heart disease rates. A cardiologist concludes that drinking coffee prevents heart disease. Which of the following is the most important criticism?

Accepted Answer

This is an observational study; the relationship could be explained by confounding variables.

Answer

In an observational study, people who drink more coffee may differ from non-drinkers in other ways (e.g., lifestyle, diet) that reduce heart disease risk, making the causal claim unjustified.

Question 5

A researcher conducts a randomized controlled trial with 400 participants drawn from a single urban hospital. The treatment is found to be effective. A policy maker wants to apply the findings to rural populations. What is the main concern?

Accepted Answer

The study sample from an urban hospital may not represent rural populations, limiting generalizability.

Answer

The study establishes causation within the sample but cannot automatically generalize to rural populations that differ in demographics, access to care, or other factors.

Bluebook SAT Practice Test

Bluebook SAT Practice Test

Bluebook SAT Test Evaluating Statistical Claims: Observational Studies and Experiments 4