ICF Research Methods & Evidence-Based Practice 2 — Questions and Answers
Question 1: In coaching research, what does a 'control group' allow researchers to do?
- Ensure all participants receive the coaching intervention
- Compare outcomes between those who received coaching and those who did not (Correct answer)
- Randomly assign coaches to different coaching styles
- Measure only the subjective experience of coachees
Correct answer: Compare outcomes between those who received coaching and those who did not
A control group provides a baseline comparison so researchers can attribute outcome differences to the coaching intervention rather than other factors.
Question 2: Which type of validity refers to whether a study's findings can be generalized to other populations or settings?
- Internal validity
- Construct validity
- External validity (Correct answer)
- Face validity
Correct answer: External validity
External validity concerns the generalizability of research findings beyond the specific sample and setting studied.
Question 3: A coach uses a validated psychometric tool to measure client resilience. This practice is best described as:
- Anecdotal evidence gathering
- Evidence-based assessment (Correct answer)
- Informal check-in
- Client self-report bias
Correct answer: Evidence-based assessment
Using validated psychometric tools reflects evidence-based assessment, grounding coaching practice in scientifically supported measurement.
Question 4: When reviewing coaching outcome studies, a practitioner finds that most use self-report measures. What is the primary limitation of this?
- Self-report is too expensive to collect
- Self-report data are immune to statistical analysis
- Responses may be influenced by social desirability bias (Correct answer)
- Self-report cannot measure behavioral change
Correct answer: Responses may be influenced by social desirability bias
Social desirability bias occurs when participants answer in ways they believe are expected or favorable rather than truthfully.
Question 5: Which research design is most appropriate when a coach-researcher wants to deeply explore a client's lived experience of transformation?
- Randomized controlled trial
- Meta-analysis
- Phenomenological qualitative study (Correct answer)
- Cross-sectional survey
Correct answer: Phenomenological qualitative study
Phenomenological qualitative research is designed to explore the subjective, lived experiences of individuals in depth.
Question 6: In evidence-based coaching, the term 'effect size' refers to:
- The number of participants in a study
- The practical magnitude of a coaching intervention's impact (Correct answer)
- Whether the findings are statistically significant
- The duration of the coaching program studied
Correct answer: The practical magnitude of a coaching intervention's impact
Effect size quantifies the practical significance of a finding, indicating how large or meaningful the observed change actually is.
Question 7: A coach integrates findings from a peer-reviewed meta-analysis on goal-setting into their practice. This exemplifies which ICF-aligned principle?
- Using intuition over data
- Applying evidence-based approaches to coaching (Correct answer)
- Ignoring client preferences in favor of research
- Relying exclusively on supervisor feedback
Correct answer: Applying evidence-based approaches to coaching
Integrating peer-reviewed research into practice exemplifies the evidence-based approach that ICF competencies encourage coaches to adopt.
ICF Research Methods & Evidence-Based Practice 2
In coaching research, what does a 'control group' allow researchers to do?