CCC Research Methods & Program Evaluation 3

Question 1

A counselor-researcher wants to ensure that a depression inventory consistently measures the same construct across repeated administrations over time. This property is called:

Accepted Answer

Test-retest reliability

Answer

Content validity

Answer

Construct validity

Answer

Interrater reliability

Question 2

When a research study's results can be applied to populations and settings beyond the sample studied, the study is said to have high:

Accepted Answer

External validity

Answer

Internal validity

Answer

Face validity

Answer

Concurrent validity

Question 3

In action research, the primary goal is to:

Accepted Answer

Solve practical problems within a specific context while improving practice

Answer

Produce generalizable knowledge through rigorous experimental control

Answer

Replicate findings from previously published studies

Answer

Establish population norms for a diagnostic instrument

Question 4

A researcher reports that an anxiety intervention produced a statistically significant result (p = .03) but an effect size of d = .12. A counselor should interpret this as:

Accepted Answer

Statistically significant but practically trivial in magnitude

Answer

A clinically meaningful and statistically robust finding

Answer

Invalid because the p-value and effect size contradict each other

Answer

Sufficient evidence to adopt the intervention immediately

Question 5

Which type of validity evidence is gathered by examining whether a test's items adequately represent all facets of the construct it is intended to measure?

Accepted Answer

Content validity

Answer

Predictive validity

Answer

Concurrent validity

Answer

Discriminant validity

Question 6

A counseling researcher uses member checking as a trustworthiness strategy. This involves:

Accepted Answer

Returning findings to participants to verify accuracy and resonance

Answer

Having multiple coders independently rate the same data

Answer

Keeping an audit trail of all research decisions

Answer

Using multiple data sources to corroborate findings

Question 7

In counseling research, the distinction between a Type I error and a Type II error is that:

Accepted Answer

Type I rejects a true null hypothesis; Type II fails to reject a false null hypothesis

Answer

Type I accepts a false null hypothesis; Type II rejects a true null hypothesis

Answer

Type I errors are more serious in all research contexts

Answer

Type I and Type II errors are the same thing described differently