CCC Research & Evaluation in Career Counseling 2

Question 1

A career counselor evaluates a college career center's services by measuring student employment rates before and after program participation. This is an example of:

Accepted Answer

A pre-post program evaluation design

Answer

Action research

Answer

A randomized controlled trial

Answer

Phenomenological inquiry

Question 2

Which statistical concept indicates the probability that a study's result occurred by chance alone?

Accepted Answer

p-value

Answer

Effect size

Answer

Standard deviation

Answer

Confidence interval

Question 3

Construct validity of a career interest inventory is best demonstrated by:

Accepted Answer

The instrument's ability to measure the theoretical construct it purports to assess

Answer

High consistency of scores over repeated administrations

Answer

Agreement between the test developer and a subject matter expert on item wording

Answer

Low average scores across a heterogeneous sample

Question 4

In a career counseling outcome study, an effect size of d = 0.80 is generally interpreted as:

Accepted Answer

A large, practically meaningful effect

Answer

A small, practically insignificant effect

Answer

A medium effect

Answer

An invalid result requiring replication

Question 5

Which program evaluation model emphasizes stakeholder input and the practical utility of evaluation findings for decision-making?

Accepted Answer

Utilization-focused evaluation

Answer

Goal-free evaluation

Answer

The CIPP model (Context, Input, Process, Product)

Answer

Experimental control group design

Question 6

When a career program's evaluation data show statistically significant improvement but a very small effect size, the counselor should conclude:

Accepted Answer

The improvement is real but may have limited practical importance

Answer

The program is highly effective and should be expanded immediately

Answer

The data are unreliable and the study should be repeated

Answer

The assessment instruments used were invalid

Question 7

Accountability in career services programs most directly involves:

Accepted Answer

Documenting and demonstrating program outcomes and the value of services provided

Answer

Ensuring all staff hold licensed professional counselor credentials

Answer

Limiting client caseloads to maintain counselor quality

Answer

Using only fee-based career assessments to ensure rigor