CARS CARS Evidence Evaluation and Research Methods 1 — Questions and Answers
Question 1: A CARS passage states that a study found a correlation between coffee consumption and improved memory. What is the most important limitation to consider when evaluating this claim?
- Correlation does not establish causation (Correct answer)
- The study must have used animals as subjects
- Coffee is not widely consumed in the US
- Memory cannot be measured scientifically
Correct answer: Correlation does not establish causation
Correlation between two variables does not prove that one causes the other, as a third confounding factor may be responsible.
Question 2: In a CARS passage, an author cites a single case study to support a broad universal claim. Which type of reasoning error does this represent?
- Hasty generalization (Correct answer)
- False dichotomy
- Circular reasoning
- Appeal to authority
Correct answer: Hasty generalization
Hasty generalization occurs when a sweeping conclusion is drawn from insufficient or unrepresentative evidence.
Question 3: A CARS passage describes a double-blind study. What does 'double-blind' mean in this context?
- Neither participants nor researchers know who received the treatment (Correct answer)
- The study was conducted twice to verify results
- Two separate research teams conducted the study
- Both quantitative and qualitative methods were used
Correct answer: Neither participants nor researchers know who received the treatment
In a double-blind study, neither the participants nor the researchers administering the treatment know who is in the control or experimental group, reducing bias.
Question 4: An author in a CARS passage uses only peer-reviewed journal articles published within the last five years to support an argument. What does this suggest about the evidence?
- The evidence is current and has undergone expert scrutiny (Correct answer)
- The evidence is automatically correct and unbiased
- Older research is irrelevant to all academic topics
- Only recent studies can be cited in academic work
Correct answer: The evidence is current and has undergone expert scrutiny
Peer-reviewed, recent sources indicate the evidence has been vetted by experts and reflects current knowledge, though it still requires critical evaluation.
Question 5: A CARS passage presents a study where the sample consisted entirely of college students. What methodological concern does this raise?
- The findings may not generalize to broader populations (Correct answer)
- College students are unreliable research subjects
- The study must be repeated with older participants
- Student samples are never acceptable in research
Correct answer: The findings may not generalize to broader populations
A sample limited to college students may not represent the full diversity of the population, limiting the external validity of the findings.
Question 6: Which of the following best defines 'external validity' in the context of a research study discussed in a CARS passage?
- The degree to which results can be generalized beyond the study's sample (Correct answer)
- Whether the study measures what it intends to measure
- The accuracy of the data collected during the study
- The objectivity of the researchers conducting the study
Correct answer: The degree to which results can be generalized beyond the study's sample
External validity refers to how well the findings of a study can be applied to settings, populations, or times beyond the original research context.
CARS CARS Evidence Evaluation and Research Methods 1
A CARS passage states that a study found a correlation between coffee consumption and improved memory.
What is the most important limitation to consider when evaluating this claim?