TCC Research Methods & Program Evaluation 2 — Questions and Answers
Question 1: In single-subject research designs used in counseling, what is the purpose of the 'baseline phase' (A phase)?
- To introduce the treatment intervention for the first time
- To measure the client's behavior before any intervention to establish a comparison point (Correct answer)
- To evaluate treatment effects after the intervention is complete
- To train the counselor in the correct delivery of the intervention
Correct answer: To measure the client's behavior before any intervention to establish a comparison point
The baseline (A) phase in single-subject designs records the client's behavior under natural conditions before intervention, providing a standard against which to compare treatment effects.
Question 2: When a school counselor reviews disaggregated student data (broken down by race, gender, or socioeconomic status) to evaluate their program, this practice primarily serves which goal?
- Satisfying state reporting requirements for accreditation
- Identifying and addressing equity gaps in student outcomes (Correct answer)
- Reducing the counselor's caseload to manageable levels
- Demonstrating compliance with FERPA regulations
Correct answer: Identifying and addressing equity gaps in student outcomes
Disaggregating data allows counselors to identify whether certain student groups are underserved or experiencing disparate outcomes, enabling targeted and equitable program improvements.
Question 3: Which statistical measure describes the most frequently occurring score in a distribution?
- Mean
- Median
- Mode (Correct answer)
- Standard deviation
Correct answer: Mode
The mode is the value that appears most frequently in a data set and is particularly useful with categorical data or when identifying the most common response in a counseling assessment.
Question 4: A counselor wants to evaluate whether a new social skills group reduced office referrals among participating students. Which evaluation design would be most appropriate?
- Ethnographic case study of one participant
- Pre-test/post-test comparison using office referral data before and after the group (Correct answer)
- Narrative inquiry interviews with school administrators
- Content analysis of student journals written during the group
Correct answer: Pre-test/post-test comparison using office referral data before and after the group
A pre-test/post-test design measures the same outcome variable (office referrals) before and after the intervention, providing direct evidence of change that can be attributed to the group program.
Question 5: According to the ACA Code of Ethics, research involving deception is permissible only when:
- The researcher believes the outcome will benefit the profession
- No alternative procedure is available, deception does not harm participants, and full debriefing is provided afterward (Correct answer)
- The participants are graduate students in counseling programs
- Institutional review board approval has been waived by the institution
Correct answer: No alternative procedure is available, deception does not harm participants, and full debriefing is provided afterward
The ACA Code of Ethics permits deception in research only when the study cannot be conducted otherwise, participants are not harmed, and a thorough debriefing that explains the deception is provided after participation.
Question 6: In program evaluation, 'formative evaluation' differs from 'summative evaluation' in that formative evaluation is conducted:
- After program completion to assess overall success
- During program implementation to improve the program as it runs (Correct answer)
- Only by external evaluators not affiliated with the program
- Exclusively using quantitative outcome data
Correct answer: During program implementation to improve the program as it runs
Formative evaluation occurs during program implementation and provides ongoing feedback to improve the program while it is still running, in contrast to summative evaluation which assesses the program's overall effectiveness after it ends.
TCC Research Methods & Program Evaluation 2
In single-subject research designs used in counseling, what is the purpose of the 'baseline phase' (A phase)?