Certified Program Evaluator (CPE) — Questions and Answers
Question 1: A mixed-methods evaluation uses qualitative data to explain unexpected quantitative findings. This integration strategy is called:
- Triangulation design
- Exploratory sequential design
- Explanatory sequential design (Correct answer)
- Embedded design
Correct answer: Explanatory sequential design
Explanatory sequential design collects quantitative data first, then uses qualitative data to explain or elaborate on the quantitative results.
Question 2: In which situation is a 'communication plan' MOST critical to develop at the start of a program evaluation?
- When the program has been previously evaluated with identical methods
- When the evaluation team is entirely internal to the organization
- When multiple stakeholder groups have different information needs, languages, or literacy levels (Correct answer)
- When the evaluation uses only quantitative methods
Correct answer: When multiple stakeholder groups have different information needs, languages, or literacy levels
A communication plan is most critical when diverse stakeholder groups require tailored messaging, formats, and timelines to ensure all parties receive usable information.
Question 3: Which technique involves systematically reviewing existing research findings to summarize what is known about a program's effectiveness?
- Systematic literature review (Correct answer)
- Process monitoring
- Formative evaluation
- Needs assessment
Correct answer: Systematic literature review
A systematic literature review uses rigorous methods to identify, appraise, and synthesize existing research on a topic or intervention.
Question 4: Which component of a logic model represents the ultimate, long-range change a program aims to achieve?
- Activities
- Outputs
- Short-term outcomes
- Impact (Correct answer)
Correct answer: Impact
Impact (or long-term outcomes) represents the fundamental, lasting change in conditions or well-being the program ultimately seeks to produce.
Question 5: Which scenario BEST illustrates 'stakeholder engagement' rather than mere 'stakeholder notification'?
- Inviting stakeholders to participate in interpreting evaluation data and co-developing recommendations (Correct answer)
- Posting evaluation findings on the program's annual report website
- Sending an email with the final evaluation report attached
- Presenting findings at a one-way staff meeting with no Q&A session
Correct answer: Inviting stakeholders to participate in interpreting evaluation data and co-developing recommendations
Genuine engagement involves stakeholders actively participating in interpretation and decision-making, not passively receiving completed findings.
Question 6: What distinguishes an outcome indicator from an output indicator?
- Outcome indicators measure changes in knowledge, behavior, or conditions, while output indicators measure direct products of activities (Correct answer)
- Outcome indicators are short-term, while output indicators are long-term measures
- Outcome indicators measure activities, while output indicators measure results
- Outcome indicators are always quantitative, while output indicators can be qualitative
Correct answer: Outcome indicators measure changes in knowledge, behavior, or conditions, while output indicators measure direct products of activities
Outcome indicators measure changes in knowledge, skills, behaviors, or conditions resulting from a program, while output indicators measure the direct products of program activities.
Question 7: Which threat to internal validity occurs when participants in a control group seek out alternative treatments because they know they are not receiving the intervention?
- Compensatory rivalry (Correct answer)
- Diffusion of treatment
- Compensatory equalization
- Selection bias
Correct answer: Compensatory rivalry
Compensatory rivalry (the 'John Henry effect') occurs when control group members work harder or seek alternatives because they know they are in the comparison group.
Question 8: Which of the following best describes a 'proxy indicator'?
- A measure that is reported by a third party rather than program staff
- An indicator used exclusively by external evaluators rather than program staff
- An indirect measure used when the actual outcome is too difficult or costly to measure directly (Correct answer)
- An indicator that measures program inputs rather than outputs or outcomes
Correct answer: An indirect measure used when the actual outcome is too difficult or costly to measure directly
A proxy indicator is an indirect measure used when the actual outcome cannot be directly measured, providing an approximation of the desired information.
Question 9: Why is cultural competency important in program design?
- Create bias
- Ensure appropriateness and effectiveness (Correct answer)
- Reduce access
- Ignore diversity
Correct answer: Ensure appropriateness and effectiveness
Cultural competency in program design means understanding and respecting the beliefs, values, and practices of diverse cultural groups. This ensures that program strategies, materials, and delivery methods are appropriate, accessible, and effective for all participants, leading to better engagement and outcomes.
Question 10: Which statement BEST describes the relationship between Certified Professional Electrologist certification and industry evolution?
- Requirements evolve periodically to reflect advances in knowledge and practice (Correct answer)
- Changes only occur when government mandates them
- Certification requirements never change
- Requirements become less stringent over time
Correct answer: Requirements evolve periodically to reflect advances in knowledge and practice
Certification requirements evolve to keep pace with professional and technological advances.
Question 11: Which foundational principle is MOST important for success in Certified Professional Electrologist?
- Specializing in only one narrow area
- Commitment to continuous learning, ethical practice, and quality outcomes (Correct answer)
- Maximizing financial returns
- Maintaining minimum certification requirements
Correct answer: Commitment to continuous learning, ethical practice, and quality outcomes
Success requires continuous learning, ethical practice, and focus on quality outcomes.
Question 12: Why is stakeholder engagement important?
- Delay projects
- Align goals with needs (Correct answer)
- Ignore stakeholders
- Creates conflicts
Correct answer: Align goals with needs
Stakeholder engagement is crucial because it ensures that the project or program considers the perspectives, needs, and expectations of all relevant parties. By involving stakeholders early and continuously, their input can help shape objectives and strategies, leading to better alignment of goals and increased buy-in. This fosters a sense of ownership and improves overall outcomes and sustainability.
Question 13: In UFE, 'intended users' are best described as:
- All members of the general public
- Only the program's external funders
- Academic researchers who study the program
- Specific, identified individuals who will apply evaluation findings to decisions (Correct answer)
Correct answer: Specific, identified individuals who will apply evaluation findings to decisions
Intended users in UFE are specific, named individuals—not abstract groups—who have a real stake in the evaluation and will use its findings.
Question 14: What is a performance 'dashboard' in the context of program evaluation?
- A method for collecting data from multiple stakeholder groups simultaneously
- A spreadsheet used to calculate and track program costs over time
- A formal report generated at the end of each program cycle for funders
- A visual display that aggregates key performance indicators for quick monitoring (Correct answer)
Correct answer: A visual display that aggregates key performance indicators for quick monitoring
A performance dashboard is a visual tool that aggregates key indicators in one place, providing a quick overview of program status and progress toward goals.
Question 15: Which of the following represents a concern about 'indicator creep' in performance measurement systems?
- The tendency for indicators to capture only short-term rather than long-term results
- Evaluators using indicators that are biased toward reporting positive outcomes
- The accumulation of too many indicators, making systems burdensome and unfocused (Correct answer)
- Indicators becoming outdated as program goals evolve over time
Correct answer: The accumulation of too many indicators, making systems burdensome and unfocused
Indicator creep refers to the gradual accumulation of too many performance indicators, making data collection burdensome and reducing focus on the most critical measures of success.
Question 16: What is the benefit of regular stakeholder updates?
- Ignore concerns
- Keep informed and engaged (Correct answer)
- Reduce trust
- Cause overload
Correct answer: Keep informed and engaged
Regular stakeholder updates are essential for maintaining transparency and ensuring that all relevant parties are consistently informed about project or program progress, challenges, and decisions. This proactive communication keeps stakeholders engaged, reduces surprises, and allows them to provide timely input or support. It fosters a sense of involvement and shared understanding, contributing to project success.
Question 17: Which of the following is an example of 'dissemination' as distinct from 'communication' in program evaluation?
- Holding a debrief meeting with program staff after data collection
- Publishing an evaluation brief for broad public access on an organization's website (Correct answer)
- Sending a draft report to funders for review
- Discussing preliminary themes with an advisory committee
Correct answer: Publishing an evaluation brief for broad public access on an organization's website
Dissemination refers to proactively spreading findings to broad audiences through accessible products like briefs, toolkits, or publications.
Question 18: What is the PRIMARY ethical obligation of a certified Certified Professional Electrologist professional regarding confidential information?
- Share it with colleagues who might benefit
- Discuss it informally during networking
- Use it to advance career opportunities
- Protect it from unauthorized disclosure at all times (Correct answer)
Correct answer: Protect it from unauthorized disclosure at all times
Confidentiality is a fundamental ethical obligation for certified professionals.
Question 19: When a CPE professional faces pressure to compromise professional standards, the BEST response is to:
- Ignore the pressure and continue without reporting
- Immediately resign from the position
- Document the pressure and uphold professional standards (Correct answer)
- Comply to maintain workplace relationships
Correct answer: Document the pressure and uphold professional standards
Professionals should document any pressure to compromise standards and continue upholding their obligations.
Question 20: Which of the following is a key decision-support role of a CPE during program reviews?
- Providing evidence-based findings and recommendations while respecting decision-makers' authority (Correct answer)
- Eliminating underperforming programs without stakeholder input
- Designing the program's budget allocation
- Making final program funding decisions on behalf of the agency
Correct answer: Providing evidence-based findings and recommendations while respecting decision-makers' authority
A CPE informs decisions with evidence and recommendations but does not make final funding or programmatic decisions, which remain the authority of agency leadership.
Question 21: A county health department plans a diabetes prevention program and wants to ensure sustainability beyond grant funding. Which planning strategy best addresses this?
- Limiting the program to a pilot phase only
- Embedding program components into existing clinic workflows from the outset (Correct answer)
- Maximizing program scale during the grant period
- Delaying sustainability planning until the final grant year
Correct answer: Embedding program components into existing clinic workflows from the outset
Integrating program elements into routine clinical operations from day one builds institutional ownership and reduces dependence on external funding.
Question 22: In a logic model, 'outputs' are best described as:
- The direct products or deliverables of program activities (Correct answer)
- The assumptions underlying the program
- The resources invested in a program
- Long-term community changes
Correct answer: The direct products or deliverables of program activities
Outputs are the direct, measurable products of program activities, such as the number of training sessions held or participants served.
Question 23: An evaluator calculates a Cronbach's alpha of 0.58 for a program satisfaction survey. This result indicates:
- High construct validity of the instrument
- Questionable reliability suggesting items should be revised (Correct answer)
- Excellent internal consistency requiring no changes
- Strong test-retest reliability over time
Correct answer: Questionable reliability suggesting items should be revised
Cronbach's alpha below 0.70 is generally considered questionable reliability, indicating the survey items may not consistently measure the same construct.
Question 24: Which type of indicator would best measure program efficiency?
- Average client satisfaction score on exit surveys
- Rate of behavior change among program participants
- Number of clients served during the program period
- Cost per unit of service delivered (Correct answer)
Correct answer: Cost per unit of service delivered
Efficiency indicators measure how well resources are used to deliver outputs or outcomes, with cost per unit of service being a classic efficiency metric.
Question 25: Which stakeholder mapping tool helps evaluators prioritize engagement by assessing both interest and influence?
- Power-interest grid (Correct answer)
- SWOT analysis
- Logic model
- Gantt chart
Correct answer: Power-interest grid
A power-interest grid categorizes stakeholders by their level of influence and interest, helping evaluators prioritize engagement strategies.
Question 26: The concept of 'evaluation capacity building' refers to:
- Hiring additional external evaluators for larger studies
- Developing organizations' skills and systems to conduct ongoing self-evaluation (Correct answer)
- Increasing the budget allocated for evaluation activities
- Expanding the physical infrastructure for data storage
Correct answer: Developing organizations' skills and systems to conduct ongoing self-evaluation
Evaluation capacity building aims to strengthen organizations' internal ability to conduct, use, and champion evaluation as a regular practice.
Question 27: What is the first step in program planning?
- Identifying needs and goals (Correct answer)
- Evaluation
- Implementation
- Budgeting
Correct answer: Identifying needs and goals
The first and most fundamental step in program planning is to clearly identify the needs of the target population or problem the program aims to address, and then establish specific, overarching goals. This foundational understanding ensures the program is relevant, purposeful, and directed towards achieving desired outcomes.
Question 28: A CPE recommends ending a program based solely on low participant satisfaction scores. This approach is problematic because:
- Satisfaction scores are always unreliable
- Satisfaction surveys cost too much to administer
- Participant input is irrelevant to evaluation
- Satisfaction alone does not measure program effectiveness or outcomes (Correct answer)
Correct answer: Satisfaction alone does not measure program effectiveness or outcomes
While participant satisfaction provides useful process data, it does not measure whether the program achieved its intended outcomes or produced meaningful change.
Question 29: Which of the following represents a composite indicator?
- A time-series measure of monthly service utilization rates
- A simple count of participants who completed the program
- A single survey question asking participants to rate their satisfaction
- An index combining multiple measures such as education, income, and health into a single score (Correct answer)
Correct answer: An index combining multiple measures such as education, income, and health into a single score
A composite indicator combines multiple individual measures into a single score or index, allowing complex multidimensional constructs to be represented more simply.
Question 30: Regression discontinuity design (RDD) is appropriate when:
- Outcomes are measured at three or more time points
- Program participants are assigned based on a continuous cutoff score (Correct answer)
- The program uses a lottery to determine participant selection
- Two groups are perfectly matched on all demographic variables
Correct answer: Program participants are assigned based on a continuous cutoff score
RDD exploits a cutoff score (e.g., income threshold, test score) used for program assignment to estimate causal effects at the threshold.
Question 31: The concept of 'evaluative thinking' in organizations refers to:
- Requiring all staff to earn evaluation certifications
- Hiring more external evaluators each year
- A culture of using evidence, asking evaluative questions, and applying critical thinking to program decisions routinely (Correct answer)
- Conducting annual financial audits
Correct answer: A culture of using evidence, asking evaluative questions, and applying critical thinking to program decisions routinely
Evaluative thinking is an organizational capacity where staff at all levels habitually ask evidence-based questions and use data to inform decisions, not just during formal evaluations.
Question 32: What is the importance of resource allocation?
- Reduce efficiency
- Ignore needs
- Ensure inputs for activities (Correct answer)
- Waste resources
Correct answer: Ensure inputs for activities
Resource allocation is critical because it involves strategically distributing available financial, human, and material resources to specific program activities. Proper allocation ensures that all necessary inputs are available when needed, enabling the program to execute its activities effectively and achieve its objectives.
Question 33: What is a 'theory of action' as it relates to performance measurement?
- A method for calculating financial return on investment for a program
- A legal framework governing the conduct of certified program evaluators
- An explanation of how specific program activities are expected to produce desired outcomes (Correct answer)
- A statistical model predicting which indicators will show the most improvement
Correct answer: An explanation of how specific program activities are expected to produce desired outcomes
A theory of action describes the specific activities a program will undertake and explains how those activities are expected to produce desired changes, forming the basis for selecting relevant performance indicators.
Question 34: Which of the following is an example of an output indicator?
- Reduction in unemployment rate among program participants
- Number of training sessions delivered by program staff (Correct answer)
- Participant satisfaction with employment status one year after program
- Long-term economic impact on the surrounding community
Correct answer: Number of training sessions delivered by program staff
Outputs are the direct, countable products of program activities—such as the number of training sessions delivered—rather than the changes those activities produce.
Question 35: Which risk management approach is MOST effective for CPE professionals when evaluating potential workplace hazards?
- Reactive analysis after incidents occur
- Relying solely on historical accident data
- Delegating all safety decisions to management
- Proactive hazard identification and assessment (Correct answer)
Correct answer: Proactive hazard identification and assessment
Proactive hazard identification and assessment allows professionals to identify and mitigate risks before incidents occur.
Question 36: To maximize decision-making use of evaluation findings, a CPE should present results:
- In clear, accessible formats tailored to the specific audiences who will act on them (Correct answer)
- Only in written reports exceeding 50 pages
- Using technical jargon to demonstrate expertise
- After all possible analyses are completed, regardless of timing
Correct answer: In clear, accessible formats tailored to the specific audiences who will act on them
Findings are most useful when communicated in formats and language appropriate to each audience's context, decision timeline, and level of technical knowledge.
Question 37: A program shows statistically significant improvement in test scores. What additional consideration is critical before concluding the program caused the improvement?
- Publishing the results immediately
- Ruling out alternative explanations through design (Correct answer)
- Sample size calculation
- Switching to qualitative methods
Correct answer: Ruling out alternative explanations through design
Statistical significance alone does not establish causation; rival explanations must be ruled out through evaluation design.
Question 38: In a logic model, 'intermediate outcomes' refer to:
- The activities conducted by program staff to deliver services
- Changes in attitudes, knowledge, or skills that occur as a result of program activities (Correct answer)
- The resources invested in a program such as staff and funding
- The long-term changes in community conditions that a program ultimately seeks
Correct answer: Changes in attitudes, knowledge, or skills that occur as a result of program activities
Intermediate outcomes in a logic model represent changes in attitudes, knowledge, skills, or behaviors that occur as a result of activities, preceding longer-term impacts.
Question 39: When reporting evaluation findings to a community of color that has historically been exploited by researchers, an evaluator should FIRST:
- Secure IRB approval before sharing results
- Translate all materials into the community's primary language
- Present only statistically significant findings
- Engage community members in reviewing and interpreting the findings (Correct answer)
Correct answer: Engage community members in reviewing and interpreting the findings
Culturally responsive evaluation requires community engagement in interpreting findings to ensure accuracy and build trust with historically marginalized groups.
Question 40: When performance data shows a program is not meeting its targets, evaluators should first:
- Increase the number of indicators to better capture program performance
- Immediately recommend program termination to funders and policymakers
- Reduce targets to more achievable levels without further investigation
- Investigate potential causes including data quality, implementation fidelity, and contextual factors (Correct answer)
Correct answer: Investigate potential causes including data quality, implementation fidelity, and contextual factors
When targets are not met, evaluators should investigate multiple potential causes including data quality issues, implementation problems, and external contextual factors before drawing conclusions.
Question 41: Which of the following best describes 'stretch targets' in performance measurement?
- Historical performance averages used as reference points for current performance
- Ambitious goals set beyond expected performance to encourage innovation and improvement (Correct answer)
- Targets set by external funders that programs must meet to receive continued funding
- Minimum performance thresholds programs must meet to avoid closure or sanctions
Correct answer: Ambitious goals set beyond expected performance to encourage innovation and improvement
Stretch targets are ambitious performance goals set beyond what is routinely expected, intended to motivate programs to reach higher levels of performance.
Question 42: A CPE applying UFE principles should identify the primary intended users:
- Only when findings are inconclusive
- At the start of the evaluation, before data collection begins (Correct answer)
- During the dissemination phase
- After the evaluation report is finalized
Correct answer: At the start of the evaluation, before data collection begins
UFE requires identifying intended users at the outset so the evaluation design, questions, and methods can be tailored to ensure relevance and usability.
Question 43: When is a formative evaluation most appropriately conducted?
- During program development or early implementation to improve design (Correct answer)
- When funders require accountability reporting
- Only when a program has failed to meet its goals
- After the program has concluded to assess long-term impact
Correct answer: During program development or early implementation to improve design
Formative evaluation occurs during development or early implementation to identify improvements before the program is fully scaled.
Question 44: Which of the following is a key consideration when selecting performance indicators for a program evaluation?
- Indicators should focus exclusively on quantitative data for objectivity
- Indicators should align with the program's logic model and intended outcomes (Correct answer)
- More indicators always provide a more complete picture of program performance
- Indicators should be easy to collect regardless of their relevance to program goals
Correct answer: Indicators should align with the program's logic model and intended outcomes
Selecting indicators that align with the program's logic model and intended outcomes ensures that data collected is meaningful and directly relevant to assessing program effectiveness.
Question 45: The AEA Program Evaluation Standards include which of the following categories?
- Utility, feasibility, propriety, accuracy, and evaluation accountability (Correct answer)
- Validity, reliability, generalizability, and significance
- Formative, summative, developmental, and empowerment standards
- Quantitative, qualitative, mixed-methods, and economic standards
Correct answer: Utility, feasibility, propriety, accuracy, and evaluation accountability
The Joint Committee's Program Evaluation Standards include five categories: utility, feasibility, propriety, accuracy, and evaluation accountability.
Question 46: An evaluator discovers that a program's stated goal is 'to improve community health' with no further specification. What is the primary planning problem this represents?
- Poor staff training protocols
- Lack of SMART objectives (Correct answer)
- Insufficient funding allocation
- Inadequate stakeholder engagement
Correct answer: Lack of SMART objectives
Without Specific, Measurable, Achievable, Relevant, and Time-bound objectives, the program cannot be reliably evaluated or managed toward a defined outcome.
Question 47: A CPE professional discovers a conflict of interest in a current assignment. What is the MOST ethical course of action?
- Handle it privately without informing stakeholders
- Disclose the conflict immediately and recuse if necessary (Correct answer)
- Continue the assignment but document the conflict later
- Ignore it if no one else has noticed
Correct answer: Disclose the conflict immediately and recuse if necessary
Ethical standards require immediate disclosure of conflicts of interest to protect integrity.
Question 48: An evaluator notices that a primary stakeholder is consistently absent from scheduled meetings. What should the evaluator do?
- Proceed without their input and note the limitation in the final report
- Escalate the absence to organizational leadership as a compliance issue
- Proactively reach out to understand barriers and offer alternative engagement formats (Correct answer)
- Replace the stakeholder with another representative without consultation
Correct answer: Proactively reach out to understand barriers and offer alternative engagement formats
Proactively exploring barriers and offering flexible engagement options shows responsiveness and maximizes meaningful participation.
Question 49: In performance measurement, what does 'data disaggregation' refer to?
- Separating program administrative data from independent evaluation data
- Removing statistical outliers from a dataset before conducting analysis
- Converting qualitative data into quantitative indicators for reporting purposes
- Breaking down aggregate data by subgroups such as race, gender, or age to examine disparities (Correct answer)
Correct answer: Breaking down aggregate data by subgroups such as race, gender, or age to examine disparities
Data disaggregation involves breaking down overall program data into subgroups to identify whether outcomes differ across demographic or other characteristics, revealing potential disparities.
Question 50: When is it MOST appropriate to use participatory evaluation methods?
- When the evaluator has limited access to program participants
- When community ownership of findings and capacity building are primary goals (Correct answer)
- When rigorous experimental designs are required by the funder
- When the evaluation must be completed within a very short timeframe
Correct answer: When community ownership of findings and capacity building are primary goals
Participatory methods are most appropriate when the goal includes building community capacity and ensuring stakeholders own and act on findings.
Question 51: In Certified Professional Electrologist practice, what is the FIRST step when a safety hazard is identified in the workplace?
- Immediately secure the area and report the hazard (Correct answer)
- Continue working and report at end of shift
- Wait for a supervisor to notice the issue
- Document it for the next safety audit
Correct answer: Immediately secure the area and report the hazard
When a safety hazard is identified, the immediate priority is to secure the area to prevent injury and report the hazard through proper channels.
Question 52: What is the difference between leading and lagging indicators?
- Leading indicators measure short-term results; lagging indicators measure long-term results
- Leading indicators are collected by staff; lagging indicators are collected by participants
- Leading indicators are quantitative; lagging indicators are qualitative measures
- Leading indicators predict future performance; lagging indicators measure past performance (Correct answer)
Correct answer: Leading indicators predict future performance; lagging indicators measure past performance
Leading indicators are predictive metrics that may signal future outcomes, while lagging indicators reflect past performance and measure results after the fact.
Question 53: A program evaluation reveals that a popular program is ineffective. How should the evaluator communicate this to politically invested stakeholders?
- Soften findings by emphasizing implementation fidelity over outcomes
- Release findings only to neutral third parties to avoid direct confrontation
- Present findings transparently with contextual explanation and recommendations for program improvement (Correct answer)
- Delay the report until after the program's next funding cycle
Correct answer: Present findings transparently with contextual explanation and recommendations for program improvement
Evaluators must report findings accurately while providing context and constructive recommendations, even when findings challenge stakeholder investments.
Question 54: Utilization-Focused Evaluation (UFE), developed by Michael Quinn Patton, prioritizes:
- Maximizing the length of the evaluation report
- Minimizing stakeholder involvement to protect objectivity
- Ensuring evaluation findings are actually used by intended users for intended purposes (Correct answer)
- Publishing results in peer-reviewed journals only
Correct answer: Ensuring evaluation findings are actually used by intended users for intended purposes
UFE is premised on the idea that an evaluation's value lies in its use, so it is designed around the needs of specific intended users from the start.
Question 55: A CPE evaluator conducts focus groups but is concerned about dominant participants skewing results. What technique best mitigates this?
- Increasing group size
- Recording sessions only
- Eliminating follow-up probes
- Using a skilled facilitator with structured turn-taking (Correct answer)
Correct answer: Using a skilled facilitator with structured turn-taking
A skilled facilitator using structured turn-taking ensures all voices are heard and prevents dominance bias.
Question 56: In Certified Professional Electrologist, what is the PRIMARY purpose of conducting regular safety drills and exercises?
- To satisfy insurance requirements only
- To ensure personnel can respond effectively in emergencies (Correct answer)
- To evaluate employee performance reviews
- To reduce daily workload
Correct answer: To ensure personnel can respond effectively in emergencies
Regular safety drills ensure that all personnel are prepared to respond effectively during actual emergencies.
Question 57: When findings from an evaluation are NOT used, a CPE should FIRST examine:
- Whether the evaluation questions and design were aligned with the actual information needs of decision-makers (Correct answer)
- Whether to rewrite the entire report from scratch
- Whether to abandon the evaluation profession
- Whether to increase the report's length and technical detail
Correct answer: Whether the evaluation questions and design were aligned with the actual information needs of decision-makers
Non-use most commonly results from a misalignment between the evaluation's focus and what decision-makers actually needed, pointing to an upstream design problem.
Question 58: What does the acronym SMART stand for in the context of performance indicators?
- Simple, Measurable, Attainable, Responsive, Timely
- Strategic, Meaningful, Actionable, Realistic, Trackable
- Specific, Measurable, Achievable, Relevant, Time-bound (Correct answer)
- Systematic, Manageable, Accurate, Reliable, Transparent
Correct answer: Specific, Measurable, Achievable, Relevant, Time-bound
SMART stands for Specific, Measurable, Achievable, Relevant, and Time-bound—criteria ensuring indicators are well-defined and trackable.
Question 59: When setting performance targets, evaluators should ensure that targets are:
- Based solely on funder requirements without regard to program context
- Based exclusively on national benchmark data regardless of local conditions
- Ambitious enough to challenge staff but realistic given available resources and context (Correct answer)
- Deliberately vague to allow for flexible interpretation after the fact
Correct answer: Ambitious enough to challenge staff but realistic given available resources and context
Performance targets should be ambitious enough to drive improvement but realistic given the program's resources, capacity, and context in order to be credible and motivating.
Question 60: Why is sampling important in data collection?
- Reduce accuracy
- Ignore population
- Representative subset (Correct answer)
- Increase workload
Correct answer: Representative subset
Sampling is crucial in data collection because it allows evaluators to gather information from a smaller, manageable subset of a larger population. When done correctly, this subset is representative of the entire population, enabling evaluators to draw valid conclusions and make inferences about the whole group without needing to collect data from every single individual.
Question 61: In participatory evaluation, stakeholders are involved in which phases?
- Only reporting to ensure findings are understood
- Only the initial needs assessment phase
- Multiple phases including design, data collection, and interpretation (Correct answer)
- Only data collection to prevent bias in design
Correct answer: Multiple phases including design, data collection, and interpretation
Participatory evaluation engages stakeholders throughout the entire evaluation process to increase relevance, ownership, and utilization of findings.
Question 62: Which risk management approach is MOST effective for CPE professionals when evaluating potential workplace hazards?
- Relying solely on historical accident data
- Proactive hazard identification and assessment (Correct answer)
- Reactive analysis after incidents occur
- Delegating all safety decisions to management
Correct answer: Proactive hazard identification and assessment
Proactive hazard identification and assessment allows professionals to identify and mitigate risks before incidents occur.
Question 63: A stakeholder requests access to raw evaluation data containing personally identifiable information. How should the evaluator respond?
- Refuse all data sharing until legal counsel reviews the request
- Provide aggregated or de-identified data that protects participant confidentiality (Correct answer)
- Share data only if the stakeholder signs a nondisclosure agreement
- Share the data since stakeholders have a right to all evaluation materials
Correct answer: Provide aggregated or de-identified data that protects participant confidentiality
Evaluators must protect participant confidentiality by sharing only aggregated or de-identified data with stakeholders.
Question 64: Which evaluation communication product is BEST suited for policymakers who need quick, decision-relevant information?
- Data tables with statistical analyses and confidence intervals
- Transcripts from focus groups and key informant interviews
- Two-page policy brief with key findings and actionable recommendations (Correct answer)
- Full technical evaluation report with appendices
Correct answer: Two-page policy brief with key findings and actionable recommendations
Policy briefs distill findings into concise, decision-focused formats that match the time constraints and information needs of policymakers.
Question 65: When conducting a culturally responsive evaluation, which stakeholder engagement practice is MOST important?
- Translate all instruments into multiple languages as the primary adaptation strategy
- Involve community members in co-designing evaluation questions and methods (Correct answer)
- Focus engagement exclusively on program staff who understand community context
- Hire evaluators from the target community to replace external evaluators
Correct answer: Involve community members in co-designing evaluation questions and methods
Co-designing evaluation questions with community members ensures cultural relevance and improves the validity of findings.
Question 66: A program planner wants to build in fidelity checks during implementation. This is best described as part of which planning phase?
- Impact assessment
- Process evaluation planning (Correct answer)
- Stakeholder dissemination
- Outcome mapping
Correct answer: Process evaluation planning
Fidelity monitoring is a core component of process evaluation, ensuring the program is delivered as designed before assessing outcomes.
Question 67: How does the CPE body of knowledge relate to daily professional practice?
- It only applies during exams
- It is only for academic research
- It is theoretical with limited application
- It provides the foundational framework guiding decision-making and standard practices (Correct answer)
Correct answer: It provides the foundational framework guiding decision-making and standard practices
The body of knowledge provides the framework guiding daily decision-making and practices.
Question 68: A CPE is asked to assess whether a program should be replicated in other states. This is an example of a:
- Process monitoring question
- Formative evaluation question
- Summative evaluation question focused on scalability and effectiveness (Correct answer)
- Needs assessment question
Correct answer: Summative evaluation question focused on scalability and effectiveness
Questions about replication require summative evidence of effectiveness and contextual factors that support or limit scale-up.
Question 69: A funder insists on framing evaluation questions in a way that the evaluator believes will bias results. What is the evaluator's BEST response?
- Accept the funder's framing to preserve the contract relationship
- Negotiate alternative questions that meet the funder's needs without compromising validity (Correct answer)
- Answer the biased questions but add a disclaimer in the report
- Withdraw from the evaluation immediately
Correct answer: Negotiate alternative questions that meet the funder's needs without compromising validity
Professional evaluators negotiate with funders to align evaluation questions with both funder needs and methodological integrity.
Question 70: Which stakeholder group is MOST important to involve in developing or reviewing a program's logic model?
- Only the funding agency
- External academic researchers only
- Program staff and participants, as well as other key stakeholders (Correct answer)
- Federal auditors exclusively
Correct answer: Program staff and participants, as well as other key stakeholders
Inclusive development of a logic model—involving program staff, participants, and key stakeholders—ensures it reflects real program theory and builds shared understanding.
Question 71: A health promotion program's logic model includes 'increased knowledge' as a short-term outcome. Which measurement approach is most appropriate to assess this outcome?
- Observation of session attendance
- Staff performance reviews
- Six-month follow-up health records
- Pre- and post-program knowledge assessments (Correct answer)
Correct answer: Pre- and post-program knowledge assessments
Pre-post knowledge assessments directly measure change in participant knowledge attributable to program participation within the relevant timeframe.
Question 72: In content analysis of qualitative data, 'coding' refers to:
- Assigning labels to segments of data to identify themes (Correct answer)
- Encrypting sensitive data for privacy
- Entering data into a spreadsheet
- Programming the evaluation database
Correct answer: Assigning labels to segments of data to identify themes
Coding in qualitative analysis involves systematically labeling data segments to identify patterns and themes.
Question 73: What is the PRIMARY purpose of obtaining CPE certification in Certified Professional Electrologist?
- To demonstrate verified competency and adherence to professional standards (Correct answer)
- To bypass educational requirements
- To satisfy a personal achievement goal
- To guarantee employment
Correct answer: To demonstrate verified competency and adherence to professional standards
Certification demonstrates verified competency and adherence to professional standards.
Question 74: Interrater reliability is most important when data collection involves:
- Automated software scoring
- Multiple human coders categorizing qualitative data (Correct answer)
- Single-item surveys
- Administrative record extraction
Correct answer: Multiple human coders categorizing qualitative data
Interrater reliability ensures that multiple human coders assign the same categories to data consistently, reducing subjective bias.
Question 75: An evaluator is working with a program serving a marginalized population. Stakeholders from that population are absent from decision-making tables. What should the evaluator do?
- Focus data collection on the population without involving them in design decisions
- Accept the existing stakeholder structure as given by the client
- Report findings directly to the marginalized population, bypassing program leadership
- Advocate for including representatives from the marginalized population in evaluation governance (Correct answer)
Correct answer: Advocate for including representatives from the marginalized population in evaluation governance
Evaluators committed to equity advocate for meaningful inclusion of marginalized populations in evaluation governance and decision-making.
Question 76: A community-based organization is skeptical of an external evaluator's presence. What engagement strategy would MOST effectively build trust?
- Offer financial incentives for participation from the first meeting
- Begin data collection immediately to demonstrate efficiency
- Start with listening sessions to understand community concerns and evaluation history (Correct answer)
- Emphasize the evaluator's credentials and prior work with similar organizations
Correct answer: Start with listening sessions to understand community concerns and evaluation history
Listening sessions that surface community concerns and prior negative experiences with evaluation build trust through genuine responsiveness.
Question 77: How can communication improve stakeholder relationships?
- Ignore concerns
- Build trust and clarity (Correct answer)
- Reduce transparency
- Create misunderstandings
Correct answer: Build trust and clarity
Open and consistent communication with stakeholders fosters an environment of trust and clarity. By regularly sharing information, addressing concerns, and providing opportunities for feedback, misunderstandings are reduced, and expectations are managed effectively. This transparency and responsiveness strengthen relationships, leading to greater collaboration and support for project goals.
Question 78: What is the 'attribution problem' in performance measurement?
- The challenge of attributing costs accurately to individual program activities
- The issue of data ownership when multiple agencies co-deliver a program
- The problem of determining whether observed outcomes are caused by the program versus external factors (Correct answer)
- The difficulty of assigning credit for outcomes to specific program staff members
Correct answer: The problem of determining whether observed outcomes are caused by the program versus external factors
The attribution problem refers to the challenge of determining whether observed outcomes are caused by the program rather than by external factors, confounds, or other interventions.
Question 79: What is a performance indicator?
- A narrative description of program activities and services
- A measurable value that demonstrates how effectively a program is achieving its objectives (Correct answer)
- A budget line item that tracks program spending
- A staff performance review metric used in annual evaluations
Correct answer: A measurable value that demonstrates how effectively a program is achieving its objectives
A performance indicator is a measurable value that demonstrates how effectively a program is achieving its intended outcomes and objectives.
Question 80: When selecting evidence-based interventions (EBIs) for a new program, a planner should FIRST assess which of the following?
- How long the EBI has been in existence
- Whether local staff prefer the EBI's model
- Whether the EBI has been tested with populations similar to the target community (Correct answer)
- The cost of the EBI relative to other options
Correct answer: Whether the EBI has been tested with populations similar to the target community
Population fit—whether the EBI's evidence base includes demographically or contextually similar groups—is the prerequisite for valid adaptation and effective outcomes.
Question 81: In the context of evaluation decision making, 'formative evaluation' is designed to:
- Judge a completed program's overall worth
- Measure long-term community impact only
- Improve a program while it is still being developed or implemented (Correct answer)
- Determine whether a program should be terminated
Correct answer: Improve a program while it is still being developed or implemented
Formative evaluation provides ongoing feedback to program developers and implementers to improve the program during its development or operation.
Question 82: Which communication strategy is MOST effective when presenting negative evaluation findings to program funders?
- Lead with contextual strengths before presenting areas for improvement (Correct answer)
- Minimize negative findings to maintain funder support
- Present only data without interpretation to avoid bias
- Send written reports only to allow funders to process independently
Correct answer: Lead with contextual strengths before presenting areas for improvement
Framing findings within context—acknowledging strengths first—makes negative results more actionable and less defensive for funders.
Question 83: An evaluator presents preliminary findings to program staff before finalizing the report. This practice is called:
- Audit trail
- Peer debriefing
- Member checking (Correct answer)
- Triangulation
Correct answer: Member checking
Member checking involves sharing preliminary findings with study participants or program stakeholders to verify accuracy and interpretation of data.
Question 84: Which type of evaluation question asks 'Is this program reaching the people it is intended to serve?'
- Cost-effectiveness question
- Impact question
- Attribution question
- Coverage or reach question (Correct answer)
Correct answer: Coverage or reach question
Coverage or reach questions assess whether the program is accessing and serving its target population as intended.
Question 85: What is a baseline measurement in performance measurement?
- The average performance level across all program sites nationally
- The target level of performance established by funders or policymakers
- The initial data point collected before or at the start of a program (Correct answer)
- The minimum acceptable performance standard for a funded program
Correct answer: The initial data point collected before or at the start of a program
A baseline measurement is the initial data point collected before or at program start, against which future measurements are compared to assess change.
Question 86: Which statement BEST describes the relationship between Certified Professional Electrologist certification and industry evolution?
- Requirements become less stringent over time
- Requirements evolve periodically to reflect advances in knowledge and practice (Correct answer)
- Changes only occur when government mandates them
- Certification requirements never change
Correct answer: Requirements evolve periodically to reflect advances in knowledge and practice
Certification requirements evolve to keep pace with professional and technological advances.
Question 87: A program's Theory of Change should be developed:
- Exclusively by external evaluators, not program staff
- Before program implementation to guide design and evaluation planning (Correct answer)
- After the final evaluation report is published
- Only when a program fails its audit
Correct answer: Before program implementation to guide design and evaluation planning
Developing a Theory of Change before implementation ensures the program's design and evaluation plan are aligned with intended causal pathways.
Question 88: Which factor MOST threatens the utilization of evaluation findings?
- Having too many evaluation questions
- Involving stakeholders in instrument review
- Using mixed methods
- Findings delivered too late to inform the decision they were meant to support (Correct answer)
Correct answer: Findings delivered too late to inform the decision they were meant to support
Timeliness is critical in evaluation use; findings that arrive after key decisions have been made cannot influence those decisions regardless of their quality.
Question 89: When conducting a risk assessment for CPE operations, which factor should receive the HIGHEST priority?
- Cost of implementing safety measures
- Time required for safety training
- Convenience for daily operations
- Probability and severity of potential harm (Correct answer)
Correct answer: Probability and severity of potential harm
The probability and severity of potential harm are the primary factors in risk assessment.
Question 90: What is the MOST effective way for new CPE professionals to build competency?
- Studying certification materials exclusively
- Learning through trial and error
- Focusing solely on advanced topics
- Combining formal education, mentored practice, and ongoing professional development (Correct answer)
Correct answer: Combining formal education, mentored practice, and ongoing professional development
Building competency requires formal education, mentored practice, and ongoing development.
Question 91: When conducting a risk assessment for CPE operations, which factor should receive the HIGHEST priority?
- Probability and severity of potential harm (Correct answer)
- Cost of implementing safety measures
- Time required for safety training
- Convenience for daily operations
Correct answer: Probability and severity of potential harm
The probability and severity of potential harm are the primary factors in risk assessment.
Question 92: In logic model terminology, 'reach' refers to:
- The program's social media follower count
- The length of the evaluation report
- The number and characteristics of people who participate in or are affected by the program (Correct answer)
- The geographic distance between program sites
Correct answer: The number and characteristics of people who participate in or are affected by the program
Reach describes the scope and characteristics of the population that participates in or is influenced by the program's activities.
Question 93: Which of the following BEST represents a 'two-way communication' model in program evaluation?
- Posting evaluation results on a public website for comment
- Delivering a final report to stakeholders at the end of the evaluation
- Sending progress updates via email newsletter to all stakeholders
- Regularly soliciting stakeholder feedback on evaluation processes and preliminary findings (Correct answer)
Correct answer: Regularly soliciting stakeholder feedback on evaluation processes and preliminary findings
Two-way communication requires active feedback mechanisms where stakeholders can respond to and shape evaluation processes, not just receive information.
Question 94: A logic model's 'activities' box should most directly correspond to which other element?
- Long-term outcomes
- Short-term outcomes
- Inputs (Correct answer)
- Assumptions
Correct answer: Inputs
Activities are the direct conversion of inputs (staff, funding, materials) into program services, making inputs their most direct antecedent in the logic model.
Question 95: Which tool is MOST useful for identifying gaps between a program's Theory of Change and its actual implementation?
- An implementation fidelity assessment (Correct answer)
- A media coverage analysis
- A participant satisfaction survey only
- A financial audit trail
Correct answer: An implementation fidelity assessment
An implementation fidelity assessment examines whether the program is being delivered as designed, revealing gaps between theory and practice.
Question 96: Which type of evaluation design is most appropriate when random assignment is not feasible and the program has already launched?
- Randomized controlled trial
- Purely qualitative case study
- Pre-experimental one-group pretest-posttest
- Quasi-experimental design with a matched comparison group (Correct answer)
Correct answer: Quasi-experimental design with a matched comparison group
A quasi-experimental design using a matched comparison group provides stronger causal inference than a single-group design when random assignment is impossible.
Question 97: In utilization-focused evaluation, an 'evaluation matrix' is used to:
- Calculate cost-benefit ratios
- Organize evaluation questions, indicators, data sources, and methods in a single planning document (Correct answer)
- Determine participant eligibility
- Score evaluators' performance
Correct answer: Organize evaluation questions, indicators, data sources, and methods in a single planning document
An evaluation matrix aligns key questions with measurable indicators, data sources, and collection methods, ensuring the evaluation design is coherent and comprehensive.
Question 98: When designing a data collection instrument for a diverse population, an evaluator should prioritize:
- Maximizing the number of questions
- Cultural responsiveness and plain language (Correct answer)
- Using technical jargon to appear credible
- Avoiding any demographic questions
Correct answer: Cultural responsiveness and plain language
Culturally responsive instruments in plain language ensure all participants can understand and respond accurately.
Question 99: What is active listening in communication?
- Avoiding feedback
- Concentrating and responding (Correct answer)
- Ignoring speaker
- Interrupting
Correct answer: Concentrating and responding
Active listening is a communication technique where the listener fully concentrates on what the speaker is saying, both verbally and non-verbally. It involves not just hearing words, but also understanding the message, asking clarifying questions, and providing thoughtful responses. This demonstrates respect and ensures accurate comprehension, fostering better communication and stronger relationships.
Question 100: Why tailor messages to stakeholders?
- Use jargon only
- Confuse audiences
- Ensure relevance and understanding (Correct answer)
- Ignore feedback
Correct answer: Ensure relevance and understanding
Tailoring messages to different stakeholder groups ensures that the information is presented in a way that is relevant to their interests and easily understood. Using appropriate language, focusing on key impacts, and choosing suitable communication channels helps to avoid jargon and confusion. This maximizes engagement and ensures that the message resonates effectively with each audience, leading to better comprehension and action.
Question 101: A researcher finds a statistically significant difference between groups (p=0.03) but Cohen's d is 0.08. The evaluator should conclude that:
- The results are not trustworthy due to measurement error
- The intervention has a meaningful practical impact
- The finding is statistically significant but has negligible practical effect size (Correct answer)
- The study lacks sufficient statistical power
Correct answer: The finding is statistically significant but has negligible practical effect size
A Cohen's d of 0.08 represents a trivial effect size; statistical significance with large samples does not guarantee practical or program relevance.
Question 102: A CPE conducting a 'developmental evaluation' is MOST likely working with:
- A program with a completed randomized control trial
- A stable, well-established program in its maintenance phase
- An innovative program or initiative still being designed and adapted in real time (Correct answer)
- A terminated program undergoing post-mortem review
Correct answer: An innovative program or initiative still being designed and adapted in real time
Developmental evaluation supports the design and adaptation of new or innovative programs by embedding real-time learning and feedback into ongoing development.
Question 103: How does cultural awareness improve communication?
- Create bias
- Reduce inclusion
- Respect diversity and clarity (Correct answer)
- Ignore differences
Correct answer: Respect diversity and clarity
Cultural awareness in communication involves understanding and respecting the diverse values, beliefs, and communication styles of different cultural groups. This sensitivity helps to tailor messages appropriately, avoid misunderstandings, and build rapport across cultural boundaries. By acknowledging and adapting to cultural differences, communication becomes clearer, more inclusive, and more effective for all parties involved.
Question 104: What is the role of formative evaluation?
- Ignore progress
- Final grading only
- Feedback for improvement (Correct answer)
- Only summative
Correct answer: Feedback for improvement
Formative evaluation is conducted during the early and ongoing stages of program implementation to provide continuous feedback. Its primary role is to identify areas for improvement, allowing program managers to make necessary adjustments and refine strategies to enhance the program's effectiveness before it concludes.
Question 105: Why set measurable objectives?
- Track progress and effectiveness (Correct answer)
- Increase confusion
- Reduce accountability
- Ignore results
Correct answer: Track progress and effectiveness
Setting measurable objectives allows program managers to quantify the desired changes or achievements expected from the program. These objectives provide clear benchmarks against which progress can be tracked, enabling effective monitoring, evaluation of effectiveness, and accountability for results.
Question 106: What documentation is MOST critical to maintain for safety compliance in the Certified Professional Electrologist field?
- Employee vacation schedules
- Client marketing preferences
- Annual revenue reports
- Incident reports, training records, and inspection logs (Correct answer)
Correct answer: Incident reports, training records, and inspection logs
Incident reports, training records, and inspection logs are essential safety documentation for demonstrating compliance.
Question 107: A CPE certified professional is asked to provide services outside their scope of competence. The CORRECT ethical response is to:
- Accept but charge a lower rate
- Decline and refer to a qualified professional (Correct answer)
- Accept and learn as they go
- Accept the work to gain new experience
Correct answer: Decline and refer to a qualified professional
Ethical practice requires professionals to work within their scope of competence.
Question 108: In Certified Professional Electrologist, what is the PRIMARY purpose of conducting regular safety drills and exercises?
- To evaluate employee performance reviews
- To ensure personnel can respond effectively in emergencies (Correct answer)
- To satisfy insurance requirements only
- To reduce daily workload
Correct answer: To ensure personnel can respond effectively in emergencies
Regular safety drills ensure that all personnel are prepared to respond effectively during actual emergencies.
Question 109: A CPE evaluator discovers that data collectors recorded information inconsistently across sites. This is an example of which threat to data quality?
- History
- Maturation
- Attrition
- Instrumentation (Correct answer)
Correct answer: Instrumentation
Instrumentation threat occurs when changes in measurement procedures or observers affect data consistency and validity.
Question 110: How does data analysis support evaluation?
- Ignore data
- Hide results
- Delay reports
- Inform decisions (Correct answer)
Correct answer: Inform decisions
Data analysis is crucial in program evaluation as it transforms raw data into meaningful insights and evidence. By identifying patterns, trends, and relationships within the data, evaluators can draw conclusions about a program's effectiveness, efficiency, and impact. These evidence-based findings then directly inform stakeholders' decisions regarding program improvement, continuation, or replication.
Question 111: Which evaluation approach is MOST appropriate when a program has strong prior evidence of effectiveness and the focus is on improving delivery?
- Retrospective cost analysis only
- Summative impact evaluation
- Developmental or improvement-focused formative evaluation (Correct answer)
- Meta-analysis of external studies
Correct answer: Developmental or improvement-focused formative evaluation
When effectiveness is already established, a developmental or formative evaluation focuses on optimizing implementation quality and fidelity.
Question 112: A program serving immigrant families adds culturally adapted materials but does not change core intervention components. This is an example of:
- Program abandonment
- Deep structural adaptation
- Surface-level adaptation (Correct answer)
- Core component drift
Correct answer: Surface-level adaptation
Surface-level adaptation modifies language, visuals, and cultural references while preserving the evidence-based core components that drive outcomes.
Question 113: Which of the following BEST describes 'process use' in evaluation?
- The steps followed to collect quantitative data
- Learning and changes that occur as a result of participating in the evaluation process itself (Correct answer)
- Using the evaluation findings after the report is published
- The financial process for billing evaluation services
Correct answer: Learning and changes that occur as a result of participating in the evaluation process itself
Process use refers to the learning and organizational changes that happen because stakeholders are engaged in the evaluation process, independent of the final findings.
Question 114: Which personal protective equipment (PPE) principle applies to ALL CPE certified professionals regardless of their specific role?
- Any PPE will provide adequate protection
- PPE is only necessary during formal inspections
- PPE must be properly fitted, maintained, and replaced as needed (Correct answer)
- PPE is optional if experienced in the field
Correct answer: PPE must be properly fitted, maintained, and replaced as needed
Regardless of experience level, PPE must be properly fitted, regularly maintained, and replaced when worn or damaged.
Question 115: What is the main advantage of using administrative data for performance measurement?
- It allows for random assignment to treatment and control conditions for experimental design
- Administrative data is always more accurate than data collected through primary research
- Administrative data captures stakeholder perspectives more comprehensively than surveys
- It is typically collected as part of routine program operations, making it cost-effective to use (Correct answer)
Correct answer: It is typically collected as part of routine program operations, making it cost-effective to use
Administrative data is collected as part of routine program operations (e.g., intake forms, service records), making it cost-effective to use for performance measurement without additional data collection burden.
Question 116: In logic model-based evaluation, which data type is most appropriate for measuring 'inputs'?
- Long-term community outcomes
- Participant satisfaction ratings
- Resources such as staff hours, funding, and materials (Correct answer)
- Behavioral change indicators
Correct answer: Resources such as staff hours, funding, and materials
Inputs in a logic model refer to the resources invested in a program, including staff, funding, equipment, and materials.
Question 117: What is the primary purpose of benchmarking in performance measurement?
- To evaluate individual staff performance against organizational standards
- To compare a program's performance against standards, peers, or best practices (Correct answer)
- To determine the statistical significance of outcome differences
- To establish budget allocations for the next program cycle
Correct answer: To compare a program's performance against standards, peers, or best practices
Benchmarking compares a program's performance against external standards, similar programs, or best practices to provide context for interpreting results.
Question 118: What is the MOST significant risk when an evaluator becomes overly aligned with program staff perspectives?
- Evaluator independence may be compromised, leading to biased findings (Correct answer)
- Stakeholder advisory group members may feel excluded from the process
- The evaluation timeline may be extended due to additional meetings
- Staff may demand higher compensation for evaluation participation
Correct answer: Evaluator independence may be compromised, leading to biased findings
Over-alignment with program staff threatens evaluator independence and can lead to findings that reflect staff preferences rather than objective evidence.
Question 119: Which personal protective equipment (PPE) principle applies to ALL CPE certified professionals regardless of their specific role?
- PPE is optional if experienced in the field
- PPE must be properly fitted, maintained, and replaced as needed (Correct answer)
- Any PPE will provide adequate protection
- PPE is only necessary during formal inspections
Correct answer: PPE must be properly fitted, maintained, and replaced as needed
Regardless of experience level, PPE must be properly fitted, regularly maintained, and replaced when worn or damaged.
Question 120: A logic model that includes only outputs and no outcomes is problematic because it:
- Includes too many stakeholder perspectives
- Exceeds the required page limit for grant applications
- Fails to articulate the change the program aims to create (Correct answer)
- Makes data collection too complex
Correct answer: Fails to articulate the change the program aims to create
Without outcomes, a logic model only tracks what a program does, not what difference it makes, undermining the evaluation's ability to assess effectiveness.
Certified Program Evaluator (CPE)
The NCRA Certified Program Evaluator (CPE) certifies professionals to conduct on-site evaluations of court reporting educational programs, assessing curriculum, faculty, student outcomes, and institutional compliance against established standards.
Exam Rules
- You can skip questions and return to them later
- Flag questions for review before submitting
- No feedback shown until you submit the entire exam
- Unanswered questions count as wrong — answer everything
- 10 pretest questions are mixed in and don't affect your score
- Timer auto-submits when time runs out
- Your progress is auto-saved every 30 seconds