AWA Evaluating Evidence and Assumptions 4 — Questions and Answers
Question 1: An argument uses the phrase 'studies show' without citing specific research. How should an AWA evaluator treat this evidence?
- Accept it as authoritative since studies are reliable
- Treat it as strong evidence if the conclusion seems reasonable
- Question it because vague references to studies cannot be verified or assessed for quality (Correct answer)
- Reject the entire argument based on this alone
Correct answer: Question it because vague references to studies cannot be verified or assessed for quality
Unspecified 'studies' cannot be evaluated for methodology, sample size, peer review status, or relevance, making them weak evidentiary support.
Question 2: Which of the following is an example of the 'slippery slope' fallacy in an AWA argument?
- If we allow students to retake one exam, eventually no exam will have any standards at all (Correct answer)
- Students who study more tend to earn higher grades
- The school's budget increased, and test scores also increased
- Expert educators recommend more homework for better outcomes
Correct answer: If we allow students to retake one exam, eventually no exam will have any standards at all
The slippery slope fallacy assumes that one small step will inevitably lead to extreme consequences without demonstrating why each step would necessarily follow.
Question 3: An argument concludes that a policy is effective because 'experts agree.' What question most directly evaluates this evidence?
- How many experts were surveyed?
- Are the experts qualified in the relevant field, and is there genuine consensus or just a few voices? (Correct answer)
- Were the experts paid to give their opinion?
- Did the experts review the policy before it was implemented?
Correct answer: Are the experts qualified in the relevant field, and is there genuine consensus or just a few voices?
Expert evidence requires assessing whether the experts have relevant credentials and whether their view represents a genuine consensus rather than a minority opinion.
Question 4: What does it mean to 'distinguish correlation from causation' in AWA argument analysis?
- To identify when two variables are related and conclude one causes the other
- To recognize that two variables moving together does not prove one causes the other (Correct answer)
- To show that a cause always produces the same effect
- To find a third variable that explains both correlated variables
Correct answer: To recognize that two variables moving together does not prove one causes the other
Distinguishing correlation from causation means recognizing that even a strong statistical relationship between variables does not by itself prove a causal connection.
Question 5: An argument claims: 'No complaints were filed against our product last quarter, so our product has no defects.' What assumption makes this reasoning flawed?
- Customers file complaints whenever they experience defects (Correct answer)
- Defects are always visible to customers
- The product was distributed to a large customer base
- Complaint records are kept accurately
Correct answer: Customers file complaints whenever they experience defects
The argument assumes all defects lead to complaints, but customers may tolerate minor issues, not know how to complain, or simply stop using the product instead.
Question 6: Which of the following best represents an 'appeal to tradition' fallacy in an argument?
- We should follow this hiring practice because data shows it produces better outcomes
- We should continue this policy because we have always done it this way (Correct answer)
- Experts from leading universities endorse this approach
- New research suggests revising our current method
Correct answer: We should continue this policy because we have always done it this way
Appealing to tradition argues that something is correct simply because it has been done historically, without evidence that past practice is best.
Question 7: An AWA argument presents a survey where only 30% of respondents replied. What concern does this raise?
- The survey was too long
- Non-response bias may mean the results reflect only those with strong opinions, not the full population (Correct answer)
- The survey should have been conducted online
- A 30% response rate is sufficient for any conclusion
Correct answer: Non-response bias may mean the results reflect only those with strong opinions, not the full population
Low response rates create non-response bias, as those who chose to respond may differ systematically from those who did not, skewing results.
AWA Evaluating Evidence and Assumptions 4
An argument uses the phrase 'studies show' without citing specific research.
How should an AWA evaluator treat this evidence?