LPC Research and Program Evaluation 3 — Questions and Answers
Question 1: Which of the following BEST describes the concept of internal validity in counseling research?
- The degree to which findings can be generalized to other populations
- The extent to which the study measures what it claims to measure
- The confidence that the independent variable caused the observed changes (Correct answer)
- The consistency of a measure across repeated administrations
Correct answer: The confidence that the independent variable caused the observed changes
Internal validity refers to the degree of confidence that the independent variable, not extraneous factors, caused the observed outcomes.
Question 2: A counselor researcher uses grounded theory. This approach is characterized by:
- Testing a predetermined hypothesis using statistical methods
- Developing theory inductively from systematically collected and analyzed data (Correct answer)
- Describing the lived experience of participants through bracketing
- Examining cultural practices through prolonged fieldwork
Correct answer: Developing theory inductively from systematically collected and analyzed data
Grounded theory is a qualitative methodology in which theory is developed inductively from data through systematic collection and constant comparative analysis.
Question 3: When evaluating a counseling program, which measure would BEST indicate cost-effectiveness?
- Pre-test scores on a depression inventory
- Number of sessions attended per client
- Outcomes achieved per dollar spent on the program (Correct answer)
- Client satisfaction ratings at discharge
Correct answer: Outcomes achieved per dollar spent on the program
Cost-effectiveness analysis compares program outcomes relative to the financial resources expended to determine value.
Question 4: In single-subject research, an A-B-A-B design is preferred over an A-B design because it:
- Requires fewer data points to reach conclusions
- Provides stronger evidence that the intervention caused the change (Correct answer)
- Eliminates the need for a baseline phase
- Allows for comparison across multiple participants
Correct answer: Provides stronger evidence that the intervention caused the change
The A-B-A-B design strengthens causal inference by demonstrating that behavior changes occur and reverse in alignment with the introduction and withdrawal of the intervention.
Question 5: A researcher administers the same scale to participants twice within one week and calculates a correlation of 0.91. This PRIMARILY assesses:
- Content validity
- Criterion-related validity
- Test-retest reliability (Correct answer)
- Inter-rater reliability
Correct answer: Test-retest reliability
Test-retest reliability measures the temporal stability of a scale by correlating scores from two administrations of the same instrument over a short interval.
Question 6: Which of the following represents a Type II error in hypothesis testing?
- Concluding an effect exists when the null hypothesis is actually true
- Failing to detect a true effect because the study was underpowered (Correct answer)
- Calculating an inflated p-value due to measurement error
- Applying the wrong statistical test to the data
Correct answer: Failing to detect a true effect because the study was underpowered
A Type II error (false negative) occurs when a researcher fails to reject a null hypothesis that is actually false, often due to insufficient statistical power.
Question 7: A program evaluation uses a logic model. The MAIN purpose of a logic model is to:
- Determine the statistical significance of program outcomes
- Illustrate the theoretical linkages between program inputs, activities, outputs, and outcomes (Correct answer)
- Identify ethical concerns related to participant recruitment
- Establish the qualifications required of program staff
Correct answer: Illustrate the theoretical linkages between program inputs, activities, outputs, and outcomes
A logic model visually maps the causal chain connecting a program's resources and activities to its intended short- and long-term outcomes.
LPC Research and Program Evaluation 3
Which of the following BEST describes the concept of internal validity in counseling research?