LSP Program Evaluation & Consultation 5 — Questions and Answers
Question 1: An evaluator wants to determine whether gains observed in a school intervention are due to the program or to students naturally maturing over time. The threat to internal validity being controlled for is:
- History
- Maturation (Correct answer)
- Instrumentation
- Attrition
Correct answer: Maturation
Maturation refers to changes in participants over time that occur regardless of the intervention, threatening the ability to attribute outcomes to the program.
Question 2: A psychologist is asked to help an agency develop a new trauma-informed care training program. Before designing the program, the psychologist should conduct a:
- Summative evaluation
- Formative needs assessment (Correct answer)
- Cost-benefit analysis
- Outcome replication study
Correct answer: Formative needs assessment
A formative needs assessment identifies gaps between current and desired staff competencies before program development begins.
Question 3: A key distinction between consultation and supervision is that consultation:
- Requires the consultee to implement all consultant recommendations
- Is voluntary and non-hierarchical with the consultee retaining autonomy (Correct answer)
- Transfers legal and ethical responsibility to the consultant
- Is only appropriate for licensed professionals
Correct answer: Is voluntary and non-hierarchical with the consultee retaining autonomy
Unlike supervision, consultation is non-hierarchical and voluntary; the consultee retains full professional responsibility for decisions made.
Question 4: A school district evaluates a bullying prevention program using pre- and post-surveys but has no control group. The greatest limitation of this design is:
- Small sample size
- Inability to rule out alternative explanations for change (Correct answer)
- Use of self-report measures
- Insufficient follow-up period
Correct answer: Inability to rule out alternative explanations for change
Without a control group, changes observed may reflect history, maturation, or other events rather than the intervention itself.
Question 5: Program evaluation standards developed by the Joint Committee on Standards for Educational Evaluation emphasize four qualities. Which of the following is NOT one of them?
- Utility
- Feasibility
- Propriety
- Brevity (Correct answer)
Correct answer: Brevity
The Joint Committee's four program evaluation standards are Utility, Feasibility, Propriety, and Accuracy—brevity is not among them.
Question 6: A psychologist providing consultation to a community mental health center recommends a specific evidence-based group therapy protocol. Six months later, the center reports low adoption. The MOST likely barrier is:
- Lack of evidence for the protocol's effectiveness
- Poor fit between the protocol and organizational culture or capacity (Correct answer)
- Inadequate consultation fees paid to the psychologist
- Absence of professional licensing requirements
Correct answer: Poor fit between the protocol and organizational culture or capacity
Recommendations that do not account for an organization's culture, resources, and capacity frequently fail at the implementation stage despite strong evidence bases.
Question 7: When an evaluator shares preliminary findings with program staff to check for accuracy and plausibility, this process is called:
- Peer debriefing
- Member checking (Correct answer)
- Triangulation
- Negative case analysis
Correct answer: Member checking
Member checking involves sharing findings or interpretations with participants or stakeholders to verify that conclusions accurately reflect their experiences and context.
LSP Program Evaluation & Consultation 5
An evaluator wants to determine whether gains observed in a school intervention are due to the program or to students naturally maturing over time.
The threat to internal validity being controlled for is: