Research and Program Evaluation Flashcards

A counselor wants to determine whether a new CBT-based group therapy program is reducing depression symptoms compared to a waitlist control. Which research design is MOST appropriate?

Answer: Randomized controlled trial (RCT)

An RCT with random assignment to treatment and control groups provides the strongest evidence for causal inference about program effectiveness.

Which of the following best describes the concept of internal validity in counseling research?

Answer: The confidence that observed changes are due to the independent variable rather than extraneous factors

Internal validity refers to the degree to which the researcher can conclude that the independent variable (e.g., treatment) caused the observed changes, ruling out alternative explanations.

A clinician reviews research showing that a therapy is effective across multiple randomized trials. Which level of evidence does this represent according to the evidence-based practice hierarchy?

Answer: Systematic review or meta-analysis of RCTs

Systematic reviews and meta-analyses synthesizing multiple RCTs represent the highest level of evidence in the evidence-based practice hierarchy.

When a researcher uses a p-value of .05 as the threshold for statistical significance, what is being controlled?

Answer: The probability of a Type I error

A p-value threshold of .05 controls the Type I error rate — the probability of incorrectly rejecting a true null hypothesis (false positive).

A researcher finds a statistically significant result (p < .01) but notes a very small effect size (d = .10). What is the most accurate interpretation?

Answer: The effect may be statistically significant but of limited practical or clinical significance

Statistical significance does not equal clinical meaningfulness; a small effect size indicates the observed difference has minimal practical impact even if statistically detectable with a large sample.

Which qualitative research approach involves exploring the lived experience of a phenomenon from the participant's perspective?

Answer: Phenomenology

Phenomenology is a qualitative method focused on understanding the essence of a lived experience as described by those who have had it.

A counseling program director wants to assess whether clients are achieving their individualized treatment goals. Which evaluation method is MOST directly aligned with this purpose?

Answer: Goal attainment scaling (GAS)

Goal Attainment Scaling (GAS) is specifically designed to measure client progress toward individually defined treatment goals, making it ideal for this purpose.