Certified Program Evaluator (CPE) — Questions and Answers
Question 1: What is the PRIMARY ethical obligation of a certified Certified Professional Electrologist professional regarding confidential information?
- Share it with colleagues who might benefit
- Protect it from unauthorized disclosure at all times (Correct answer)
- Discuss it informally during networking
- Use it to advance career opportunities
Correct answer: Protect it from unauthorized disclosure at all times
Confidentiality is a fundamental ethical obligation for certified professionals.
Question 2: What is the primary purpose of benchmarking in performance measurement?
- To establish budget allocations for the next program cycle
- To compare a program's performance against standards, peers, or best practices (Correct answer)
- To evaluate individual staff performance against organizational standards
- To determine the statistical significance of outcome differences
Correct answer: To compare a program's performance against standards, peers, or best practices
Benchmarking compares a program's performance against external standards, similar programs, or best practices to provide context for interpreting results.
Question 3: Summative evaluation is primarily used to:
- Develop the program's initial logic model
- Train new evaluation staff
- Make judgments about a program's overall effectiveness or worth for accountability and decisions about continuation (Correct answer)
- Improve a program during implementation
Correct answer: Make judgments about a program's overall effectiveness or worth for accountability and decisions about continuation
Summative evaluation assesses a completed or mature program's effectiveness, efficiency, and value, often informing decisions about funding, continuation, or replication.
Question 4: Which factor MOST threatens the utilization of evaluation findings?
- Involving stakeholders in instrument review
- Findings delivered too late to inform the decision they were meant to support (Correct answer)
- Using mixed methods
- Having too many evaluation questions
Correct answer: Findings delivered too late to inform the decision they were meant to support
Timeliness is critical in evaluation use; findings that arrive after key decisions have been made cannot influence those decisions regardless of their quality.
Question 5: The concept of 'evaluation capacity building' refers to:
- Increasing the budget allocated for evaluation activities
- Hiring additional external evaluators for larger studies
- Expanding the physical infrastructure for data storage
- Developing organizations' skills and systems to conduct ongoing self-evaluation (Correct answer)
Correct answer: Developing organizations' skills and systems to conduct ongoing self-evaluation
Evaluation capacity building aims to strengthen organizations' internal ability to conduct, use, and champion evaluation as a regular practice.
Question 6: In Certified Professional Electrologist practice, what is the FIRST step when a safety hazard is identified in the workplace?
- Document it for the next safety audit
- Immediately secure the area and report the hazard (Correct answer)
- Continue working and report at end of shift
- Wait for a supervisor to notice the issue
Correct answer: Immediately secure the area and report the hazard
When a safety hazard is identified, the immediate priority is to secure the area to prevent injury and report the hazard through proper channels.
Question 7: Which personal protective equipment (PPE) principle applies to ALL CPE certified professionals regardless of their specific role?
- PPE is optional if experienced in the field
- PPE must be properly fitted, maintained, and replaced as needed (Correct answer)
- PPE is only necessary during formal inspections
- Any PPE will provide adequate protection
Correct answer: PPE must be properly fitted, maintained, and replaced as needed
Regardless of experience level, PPE must be properly fitted, regularly maintained, and replaced when worn or damaged.
Question 8: What is the MOST significant risk when an evaluator becomes overly aligned with program staff perspectives?
- Stakeholder advisory group members may feel excluded from the process
- Staff may demand higher compensation for evaluation participation
- The evaluation timeline may be extended due to additional meetings
- Evaluator independence may be compromised, leading to biased findings (Correct answer)
Correct answer: Evaluator independence may be compromised, leading to biased findings
Over-alignment with program staff threatens evaluator independence and can lead to findings that reflect staff preferences rather than objective evidence.
Question 9: In Certified Professional Electrologist, what is the PRIMARY purpose of conducting regular safety drills and exercises?
- To evaluate employee performance reviews
- To ensure personnel can respond effectively in emergencies (Correct answer)
- To satisfy insurance requirements only
- To reduce daily workload
Correct answer: To ensure personnel can respond effectively in emergencies
Regular safety drills ensure that all personnel are prepared to respond effectively during actual emergencies.
Question 10: Which stakeholder engagement strategy is most effective for ensuring program design reflects community priorities?
- Sharing the final program plan at a public meeting
- Hosting community advisory boards during the planning phase (Correct answer)
- Distributing surveys after the program is designed
- Asking program staff to represent community perspectives
Correct answer: Hosting community advisory boards during the planning phase
Community advisory boards engage residents and stakeholders as co-designers during planning, embedding local priorities and increasing program relevance and trust.
Question 11: Which of the following best describes 'stretch targets' in performance measurement?
- Targets set by external funders that programs must meet to receive continued funding
- Historical performance averages used as reference points for current performance
- Ambitious goals set beyond expected performance to encourage innovation and improvement (Correct answer)
- Minimum performance thresholds programs must meet to avoid closure or sanctions
Correct answer: Ambitious goals set beyond expected performance to encourage innovation and improvement
Stretch targets are ambitious performance goals set beyond what is routinely expected, intended to motivate programs to reach higher levels of performance.
Question 12: A CPE professional discovers a conflict of interest in a current assignment. What is the MOST ethical course of action?
- Handle it privately without informing stakeholders
- Ignore it if no one else has noticed
- Disclose the conflict immediately and recuse if necessary (Correct answer)
- Continue the assignment but document the conflict later
Correct answer: Disclose the conflict immediately and recuse if necessary
Ethical standards require immediate disclosure of conflicts of interest to protect integrity.
Question 13: A CPE recommends ending a program based solely on low participant satisfaction scores. This approach is problematic because:
- Participant input is irrelevant to evaluation
- Satisfaction scores are always unreliable
- Satisfaction surveys cost too much to administer
- Satisfaction alone does not measure program effectiveness or outcomes (Correct answer)
Correct answer: Satisfaction alone does not measure program effectiveness or outcomes
While participant satisfaction provides useful process data, it does not measure whether the program achieved its intended outcomes or produced meaningful change.
Question 14: A program evaluator is asked to present findings to a non-technical board audience. Which approach is MOST appropriate?
- Use statistical terminology to demonstrate methodological rigor
- Focus exclusively on limitations to set accurate expectations
- Create visual dashboards with plain-language summaries of key takeaways (Correct answer)
- Provide the full technical report to show transparency
Correct answer: Create visual dashboards with plain-language summaries of key takeaways
Non-technical audiences benefit most from visual, plain-language presentations that highlight actionable takeaways.
Question 15: A program evaluation reveals unexpected negative side effects alongside positive outcomes. A CPE is ethically obligated to:
- Report both positive and negative findings fully and transparently (Correct answer)
- Delay the report until negative findings can be explained
- Omit the negative findings to protect the program's reputation
- Share negative findings only with the evaluation sponsor privately
Correct answer: Report both positive and negative findings fully and transparently
Evaluation ethics require full and transparent reporting of all significant findings, including unintended negative consequences, to support honest decision-making.
Question 16: What distinguishes an outcome indicator from an output indicator?
- Outcome indicators are always quantitative, while output indicators can be qualitative
- Outcome indicators are short-term, while output indicators are long-term measures
- Outcome indicators measure activities, while output indicators measure results
- Outcome indicators measure changes in knowledge, behavior, or conditions, while output indicators measure direct products of activities (Correct answer)
Correct answer: Outcome indicators measure changes in knowledge, behavior, or conditions, while output indicators measure direct products of activities
Outcome indicators measure changes in knowledge, skills, behaviors, or conditions resulting from a program, while output indicators measure the direct products of program activities.
Question 17: An evaluator presents preliminary findings to program staff before finalizing the report. This practice is called:
- Peer debriefing
- Triangulation
- Audit trail
- Member checking (Correct answer)
Correct answer: Member checking
Member checking involves sharing preliminary findings with study participants or program stakeholders to verify accuracy and interpretation of data.
Question 18: A community-based organization is skeptical of an external evaluator's presence. What engagement strategy would MOST effectively build trust?
- Start with listening sessions to understand community concerns and evaluation history (Correct answer)
- Emphasize the evaluator's credentials and prior work with similar organizations
- Begin data collection immediately to demonstrate efficiency
- Offer financial incentives for participation from the first meeting
Correct answer: Start with listening sessions to understand community concerns and evaluation history
Listening sessions that surface community concerns and prior negative experiences with evaluation build trust through genuine responsiveness.
Question 19: Which of the following is a key consideration when selecting performance indicators for a program evaluation?
- Indicators should focus exclusively on quantitative data for objectivity
- Indicators should be easy to collect regardless of their relevance to program goals
- Indicators should align with the program's logic model and intended outcomes (Correct answer)
- More indicators always provide a more complete picture of program performance
Correct answer: Indicators should align with the program's logic model and intended outcomes
Selecting indicators that align with the program's logic model and intended outcomes ensures that data collected is meaningful and directly relevant to assessing program effectiveness.
Question 20: A stakeholder requests access to raw evaluation data containing personally identifiable information. How should the evaluator respond?
- Share data only if the stakeholder signs a nondisclosure agreement
- Provide aggregated or de-identified data that protects participant confidentiality (Correct answer)
- Refuse all data sharing until legal counsel reviews the request
- Share the data since stakeholders have a right to all evaluation materials
Correct answer: Provide aggregated or de-identified data that protects participant confidentiality
Evaluators must protect participant confidentiality by sharing only aggregated or de-identified data with stakeholders.
Question 21: What is formative evaluation?
- At the end only
- During implementation (Correct answer)
- Only for grading
- Ignore feedback
Correct answer: During implementation
Formative evaluation is conducted during the development or implementation phase of a program or project. Its primary purpose is to provide ongoing feedback and identify areas for improvement while the program is still in progress. This allows for timely adjustments and refinements, enhancing the program's effectiveness before its full completion.
Question 22: What is a performance indicator?
- A measurable value that demonstrates how effectively a program is achieving its objectives (Correct answer)
- A narrative description of program activities and services
- A staff performance review metric used in annual evaluations
- A budget line item that tracks program spending
Correct answer: A measurable value that demonstrates how effectively a program is achieving its objectives
A performance indicator is a measurable value that demonstrates how effectively a program is achieving its intended outcomes and objectives.
Question 23: When developing a logic model, 'assumptions' refer to:
- Output count targets
- The beliefs about how the program will work and the conditions necessary for success (Correct answer)
- Financial projections for the next fiscal year
- Participant demographic data
Correct answer: The beliefs about how the program will work and the conditions necessary for success
Assumptions in a logic model are the beliefs and conditions—such as community readiness or partner cooperation—that must hold true for the program to succeed.
Question 24: When selecting evidence-based interventions (EBIs) for a new program, a planner should FIRST assess which of the following?
- The cost of the EBI relative to other options
- How long the EBI has been in existence
- Whether local staff prefer the EBI's model
- Whether the EBI has been tested with populations similar to the target community (Correct answer)
Correct answer: Whether the EBI has been tested with populations similar to the target community
Population fit—whether the EBI's evidence base includes demographically or contextually similar groups—is the prerequisite for valid adaptation and effective outcomes.
Question 25: A 'plausibility review' of a Theory of Change asks whether:
- Staff are adequately trained
- Participant rosters are complete
- The causal links and assumptions are reasonable and supported by evidence or theory (Correct answer)
- The program has sufficient federal funding
Correct answer: The causal links and assumptions are reasonable and supported by evidence or theory
A plausibility review examines whether the causal mechanisms in the Theory of Change are logically sound and grounded in evidence or established theory.
Question 26: What is a baseline measurement in performance measurement?
- The minimum acceptable performance standard for a funded program
- The initial data point collected before or at the start of a program (Correct answer)
- The target level of performance established by funders or policymakers
- The average performance level across all program sites nationally
Correct answer: The initial data point collected before or at the start of a program
A baseline measurement is the initial data point collected before or at program start, against which future measurements are compared to assess change.
Question 27: How can communication improve stakeholder relationships?
- Create misunderstandings
- Build trust and clarity (Correct answer)
- Reduce transparency
- Ignore concerns
Correct answer: Build trust and clarity
Open and consistent communication with stakeholders fosters an environment of trust and clarity. By regularly sharing information, addressing concerns, and providing opportunities for feedback, misunderstandings are reduced, and expectations are managed effectively. This transparency and responsiveness strengthen relationships, leading to greater collaboration and support for project goals.
Question 28: Which of the following best describes a 'proxy indicator'?
- An indicator that measures program inputs rather than outputs or outcomes
- A measure that is reported by a third party rather than program staff
- An indirect measure used when the actual outcome is too difficult or costly to measure directly (Correct answer)
- An indicator used exclusively by external evaluators rather than program staff
Correct answer: An indirect measure used when the actual outcome is too difficult or costly to measure directly
A proxy indicator is an indirect measure used when the actual outcome cannot be directly measured, providing an approximation of the desired information.
Question 29: A logic model is shared with stakeholders at the start of a program evaluation. What is the PRIMARY communication purpose of this activity?
- To satisfy funder requirements for theory-of-change documentation
- To document the evaluator's methodology for the final report
- To train stakeholders in evaluation methodology
- To build shared understanding of program theory and align expectations about what will be evaluated (Correct answer)
Correct answer: To build shared understanding of program theory and align expectations about what will be evaluated
Sharing the logic model builds shared understanding of program theory and surfaces disagreements about intended outcomes before evaluation begins.
Question 30: A program evaluator wants to capture participant experiences in depth without constraining responses. Which data collection method is most appropriate?
- Structured survey
- Standardized test
- Open-ended interview (Correct answer)
- Checklist observation
Correct answer: Open-ended interview
Open-ended interviews allow participants to express experiences in their own words without predefined constraints.
Certified Program Evaluator (CPE)
The NCRA Certified Program Evaluator (CPE) certifies professionals to conduct on-site evaluations of court reporting educational programs, assessing curriculum, faculty, student outcomes, and institutional compliance against established standards.
Exam Rules
- You can skip questions and return to them later
- Flag questions for review before submitting
- No feedback shown until you submit the entire exam
- Unanswered questions count as wrong — answer everything
- 10 pretest questions are mixed in and don't affect your score
- Timer auto-submits when time runs out
- Your progress is auto-saved every 30 seconds