NCMHCE Research and Program Evaluation 4

Question 1

A counselor wants to evaluate whether a new group therapy program reduced clients' depression scores over 12 weeks. Which design best controls for threats to internal validity?

Accepted Answer

Randomized controlled trial with a waitlist control group

Answer

Single-group pretest-posttest design

Answer

Case study analysis of three participants

Answer

Retrospective chart review without a comparison group

Question 2

In a program evaluation, the evaluator finds a statistically significant result (p = .03) but a Cohen's d of 0.10. What is the most accurate interpretation?

Accepted Answer

The result is statistically significant but the effect size is negligible

Answer

The intervention is both statistically and practically significant

Answer

The p-value is too high to trust the finding

Answer

A d of 0.10 always indicates a medium effect

Question 3

Which sampling method would be most appropriate when a researcher needs to ensure representation from each of five distinct cultural communities in a city?

Accepted Answer

Stratified random sampling

Answer

Simple random sampling

Answer

Convenience sampling

Answer

Snowball sampling

Question 4

A counselor reviewing a needs assessment report notices that data were collected only from clients who completed treatment. This is an example of which bias?

Accepted Answer

Attrition bias (survivor bias)

Answer

Response bias

Answer

Social desirability bias

Answer

Instrumentation bias

Question 5

Which statistical test is most appropriate to compare pre-treatment and post-treatment anxiety scores from the same group of 30 clients?

Accepted Answer

Paired samples t-test

Answer

Independent samples t-test

Answer

Chi-square test

Answer

One-way ANOVA

Question 6

A program evaluator is asked to determine whether a school counseling intervention should be continued, modified, or discontinued. This is best described as what type of evaluation?

Accepted Answer

Summative evaluation

Answer

Formative evaluation

Answer

Needs assessment

Answer

Process evaluation

Question 7

Which of the following best illustrates a Type II error in mental health research?

Accepted Answer

Failing to detect a true treatment effect because the study was underpowered

Answer

Concluding a treatment works when it actually does not

Answer

Using an invalid measure that inflates scores

Answer

Publishing results with a p-value of .001