Psychology Degree Psychological Research Methods 5 — Questions and Answers
Question 1: Which of the following describes the ecological validity of a study?
- Whether the study measures what it claims to measure
- Whether findings apply to real-world settings and behaviors (Correct answer)
- Whether the sample adequately represents the population
- Whether measures are consistent over time
Correct answer: Whether findings apply to real-world settings and behaviors
Ecological validity concerns how well a study's conditions reflect real-world environments so that findings translate meaningfully to everyday life.
Question 2: A researcher finds p = 0.03 with a very large sample (N = 10,000). The best interpretation is:
- The result is practically important because it is statistically significant
- The result may be statistically significant but practically trivial due to large N (Correct answer)
- The null hypothesis is proven false beyond doubt
- A larger effect size is always present with large samples
Correct answer: The result may be statistically significant but practically trivial due to large N
With very large samples, even tiny, practically meaningless differences can reach statistical significance, so effect size must also be examined.
Question 3: In qualitative research, 'member checking' involves:
- Having statisticians verify data coding
- Returning findings to participants to verify accuracy and interpretation (Correct answer)
- Cross-referencing data with published literature
- Recruiting additional members to a focus group
Correct answer: Returning findings to participants to verify accuracy and interpretation
Member checking is a trustworthiness strategy where researchers share their interpretations with participants to confirm they accurately reflect participants' experiences.
Question 4: The concept of 'demand characteristics' in research refers to:
- Requirements placed on researchers by IRBs
- Cues in the study that suggest to participants what the researcher expects (Correct answer)
- The statistical demands of a given analytical method
- Physical demands placed on participants during tasks
Correct answer: Cues in the study that suggest to participants what the researcher expects
Demand characteristics are cues in the experimental situation that hint at the study's purpose, potentially causing participants to alter their behavior accordingly.
Question 5: Which research design is most appropriate for establishing the temporal precedence needed for causal inference?
- Cross-sectional survey
- Case study
- Randomized controlled experiment (Correct answer)
- Archival research
Correct answer: Randomized controlled experiment
Randomized controlled experiments manipulate the independent variable before measuring the outcome, establishing temporal order and enabling stronger causal inference.
Question 6: In ANOVA, the F-ratio compares:
- Sample mean to population mean
- Variance between groups to variance within groups (Correct answer)
- Effect size to sample size
- Observed frequencies to expected frequencies
Correct answer: Variance between groups to variance within groups
The F-ratio divides between-group variance (due to the treatment) by within-group variance (error), with larger values indicating a treatment effect.
Question 7: A researcher uses a matched-pairs design by pairing participants on IQ before assigning them to conditions. The primary goal is to:
- Increase the study's ecological validity
- Reduce error variance by controlling a potential confound (Correct answer)
- Ensure all participants receive the same treatment
- Increase the overall sample size needed
Correct answer: Reduce error variance by controlling a potential confound
Matching on a variable like IQ removes that variable's contribution to error variance, making it easier to detect the true effect of the independent variable.
Psychology Degree Psychological Research Methods 5
Which of the following describes the ecological validity of a study?