CARS CARS Evidence Evaluation and Research Methods 2 — Questions and Answers
Question 1: A CARS passage argues that because a policy worked in Sweden, it will work in the United States. Which flaw undermines this reasoning?
- Differences in cultural, political, and social context may make direct comparison invalid (Correct answer)
- Sweden is not a credible source for policy research
- The US has already tried every possible policy
- International comparisons are never useful in academic reasoning
Correct answer: Differences in cultural, political, and social context may make direct comparison invalid
Directly applying findings from one country to another ignores potentially critical contextual differences that affect outcomes.
Question 2: In a CARS passage, an author dismisses a competing study because it was published 20 years ago. Is this a strong counter-argument?
- Not necessarily, because older foundational research may still be valid and relevant (Correct answer)
- Yes, because all research becomes obsolete after a decade
- Yes, because recent studies always supersede older ones
- Not necessarily, because publication date has no bearing on quality
Correct answer: Not necessarily, because older foundational research may still be valid and relevant
Age alone does not invalidate research; some foundational studies remain highly relevant, though newer evidence may also need to be weighed.
Question 3: A CARS passage includes a graph showing a sharp rise in a variable after a new intervention. What additional information is needed before concluding the intervention caused the rise?
- Whether a control group without the intervention showed a similar rise (Correct answer)
- The exact font size used to label the graph's axes
- Whether the graph was published in a US-based journal
- How many researchers reviewed the graph before publication
Correct answer: Whether a control group without the intervention showed a similar rise
Without a control group, the observed rise could be due to other factors unrelated to the intervention, making causation impossible to confirm.
Question 4: Which of the following is an example of anecdotal evidence as it might appear in a CARS passage?
- A doctor claims a treatment works because one of her patients recovered after using it (Correct answer)
- A clinical trial of 5,000 participants showing 80% improvement
- A meta-analysis combining results from 30 independent studies
- A government report based on ten years of population data
Correct answer: A doctor claims a treatment works because one of her patients recovered after using it
Anecdotal evidence is based on personal experience or individual cases rather than systematic data collection, making it unreliable for broad conclusions.
Question 5: A CARS passage describes a researcher who designed an experiment to test her own hypothesis. What potential bias should the reader consider?
- Confirmation bias may lead the researcher to favor results that support her hypothesis (Correct answer)
- Researchers are never allowed to test their own hypotheses
- Self-designed experiments are inherently more accurate than collaborative ones
- The hypothesis is automatically correct if the researcher designed the test
Correct answer: Confirmation bias may lead the researcher to favor results that support her hypothesis
Confirmation bias occurs when researchers unconsciously seek, interpret, or report data in ways that support their pre-existing beliefs.
Question 6: When evaluating a source cited in a CARS passage, which factor is most important to assess first?
- Whether the source has a clear conflict of interest (Correct answer)
- Whether the source was written by a native English speaker
- Whether the source is available online for free
- Whether the source includes color charts and illustrations
Correct answer: Whether the source has a clear conflict of interest
Conflicts of interest—such as financial ties or ideological motivations—can compromise the objectivity and reliability of a source.
A CARS passage argues that because a policy worked in Sweden, it will work in the United States.
Which flaw undermines this reasoning?