CPSS - Certified Performance and Sport Scientist Applied Research Methods Questions and Answers — Questions and Answers
Question 1: A sport scientist has developed a new wearable device to measure jump height. To assess its consistency, the same group of athletes performs three countermovement jumps, measured by the device, on two separate days one week apart under identical conditions. The results from both sessions are highly comparable. This process is primarily assessing which type of reliability?
- Inter-rater reliability
- Internal consistency
- Test-retest reliability (Correct answer)
- Split-half reliability
Correct answer: Test-retest reliability
Test-retest reliability evaluates the consistency of results over time. By administering the same test to the same individuals on two different occasions and finding the scores to be stable and similar, the scientist is confirming the measure's test-retest reliability.
Question 2: A researcher wants to determine if a specific 8-week yoga intervention *causes* a reduction in competition anxiety more effectively than a standard stretching protocol. They randomly assign 50 swimmers to either the yoga group or the stretching (control) group and measure anxiety levels before and after the intervention. Which research design provides the strongest evidence for a causal relationship in this scenario?
- Quasi-experimental design
- Randomized controlled trial (RCT) (Correct answer)
- Correlational study
- Case study
Correct answer: Randomized controlled trial (RCT)
A randomized controlled trial (RCT) is considered the gold standard for establishing causality. The key features in this scenario are the random assignment of participants to groups and the use of a control group, which help to minimize bias and rule out confounding variables, allowing for a stronger inference that the intervention caused the observed outcome.
Question 3: A study comparing two different recovery modalities on elite cyclists finds a statistically significant difference in perceived muscle soreness (p = 0.04). However, the effect size was calculated to be very small (d = 0.1). What is the most appropriate practical interpretation of these findings for a coach?
- The finding is not trustworthy because the p-value is close to 0.05.
- The new modality is superior and should be implemented immediately for all athletes.
- The statistical significance guarantees a meaningful real-world benefit.
- While the difference is unlikely due to chance, its practical importance for performance or recovery may be negligible. (Correct answer)
Correct answer: While the difference is unlikely due to chance, its practical importance for performance or recovery may be negligible.
Statistical significance (a low p-value) indicates that an observed effect is unlikely to be due to random chance, but it does not describe the magnitude or practical importance of the effect. Effect size quantifies the magnitude of the difference. A small effect size suggests that even though a difference is statistically real, it may be too small to have a meaningful impact in a practical, real-world setting.
Question 4: To validate a new sport-specific agility test for soccer players, a researcher correlates the scores from the new test with an established gold-standard video analysis of player movements during a competitive match. A strong positive correlation is found. This provides evidence for which type of validity?
- Content validity
- Face validity
- Criterion-related validity (Correct answer)
- Construct validity
Correct answer: Criterion-related validity
Criterion-related validity assesses how well a test's outcomes correspond to the outcomes of another established measure, or 'criterion.' In this case, the new agility test scores (the measure) are being compared against a gold-standard measure of in-game performance (the criterion), making this a clear example of establishing criterion-related validity.
Question 5: A sport science department is conducting a study on the ergogenic effects of a new beetroot juice supplement on rowing performance. To minimize bias, neither the athletes participating in the study nor the researchers administering the drinks know who is receiving the actual beetroot supplement and who is receiving a non-active placebo. This research control method is known as a:
- Crossover design
- Longitudinal study
- Double-blind protocol (Correct answer)
- Case-control study
Correct answer: Double-blind protocol
A double-blind protocol is a study design in which both the participants and the experimenters are unaware of who is receiving a particular treatment. This procedure is used to prevent bias in research results, such as the placebo effect from participants or unintentional influence from the researchers.
Question 6: A performance scientist aims to understand the lived experiences and perceptions of team culture among professional rugby players. The scientist conducts a series of in-depth, open-ended interviews and focus groups, then analyzes the textual data for recurring themes and narratives. Which research paradigm does this methodology represent?
- Qualitative research (Correct answer)
- Experimental research
- Quantitative research
- Correlational research
Correct answer: Qualitative research
Qualitative research is an exploratory approach used to understand underlying reasons, opinions, and motivations. It involves collecting and analyzing non-numerical data, such as text from interviews or observations, to interpret meaning and understand social phenomena in depth.
CPSS - Certified Performance and Sport Scientist Applied Research Methods Questions and Answers
A sport scientist has developed a new wearable device to measure jump height.
To assess its consistency, the same group of athletes performs three countermovement jumps, measured by the device, on two separate days one week apart under identical conditions.
The results from both sessions are highly comparable.
This process is primarily assessing which type of reliability?