CVE Program Development & Evaluation 3 — Questions and Answers
Question 1: A vocational evaluation program is developing performance indicators. Which indicator BEST measures program efficiency?
- Percentage of clients who obtain employment
- Average cost per client served (Correct answer)
- Number of referral sources
- Client satisfaction scores
Correct answer: Average cost per client served
Average cost per client served measures efficiency by relating resource expenditure directly to service volume, enabling comparison across time periods or programs.
Question 2: A CVE is asked to implement a new assessment tool not currently in the program's approved battery. The appropriate first step is to:
- Begin using it immediately if the client consents
- Review the tool's psychometric properties and seek supervisor or committee approval (Correct answer)
- Purchase the tool and use it for a trial period without disclosure
- Refuse outright because the program battery cannot be changed
Correct answer: Review the tool's psychometric properties and seek supervisor or committee approval
Reviewing psychometric properties and obtaining appropriate approval ensures new tools meet professional and ethical standards before use with clients.
Question 3: In program planning, 'stakeholder analysis' is conducted primarily to:
- Determine salary structures for evaluators
- Identify parties who have interests in or influence over the program (Correct answer)
- Establish eligibility criteria for clients
- Set reimbursement rates with payers
Correct answer: Identify parties who have interests in or influence over the program
Stakeholder analysis identifies all parties with a vested interest in the program, enabling planners to address their needs and build support for program success.
Question 4: A vocational evaluation program's outcome data shows that 40% of clients are obtaining employment within 6 months. To determine if this is acceptable, the program director should FIRST:
- Compare the rate to national benchmarks and comparable programs (Correct answer)
- Immediately redesign the program curriculum
- Survey clients about why they did not get jobs
- Reduce caseload size to improve outcomes
Correct answer: Compare the rate to national benchmarks and comparable programs
Benchmarking against national data and comparable programs provides essential context for interpreting whether a 40% placement rate represents good, average, or poor performance.
Question 5: Which federal legislation most directly requires vocational evaluation programs to use evidence-based practices when serving individuals with disabilities?
- Americans with Disabilities Act (ADA)
- Workforce Innovation and Opportunity Act (WIOA)
- Rehabilitation Act of 1973 as amended (Correct answer)
- Social Security Act Title XVI
Correct answer: Rehabilitation Act of 1973 as amended
The Rehabilitation Act of 1973, as amended, establishes standards for state vocational rehabilitation programs including requirements for evidence-based practices in assessment and evaluation.
Question 6: When designing a program evaluation plan, which element describes 'how' data will be collected and from whom?
- Evaluation questions
- Logic model
- Data collection methodology (Correct answer)
- Budget narrative
Correct answer: Data collection methodology
Data collection methodology specifies the instruments, sources, timing, and procedures for gathering evaluation data to answer the evaluation questions.
Question 7: A program receives a grant requiring a formative evaluation. This means the evaluation will be used to:
- Judge the program's overall success at the end of funding
- Provide ongoing feedback to improve the program during implementation (Correct answer)
- Compare the program's cost-effectiveness to alternatives
- Determine whether to replicate the program in other sites
Correct answer: Provide ongoing feedback to improve the program during implementation
Formative evaluation occurs during program implementation and provides feedback that allows ongoing adjustments and improvements while the program is still running.
CVE Program Development & Evaluation 3
A vocational evaluation program is developing performance indicators.
Which indicator BEST measures program efficiency?