CPM Outcome Evaluation & Surveys 2 — Questions and Answers
Question 1: Which type of survey scale asks respondents to rate their agreement on a 5- or 7-point scale from 'Strongly Disagree' to 'Strongly Agree'?
- Guttman scale
- Likert scale (Correct answer)
- Semantic differential scale
- Visual analog scale
Correct answer: Likert scale
The Likert scale uses ordered response levels measuring agreement strength and is one of the most common tools in mentoring outcome surveys.
Question 2: A mentor wants to assess whether a mentee's confidence improved over a 6-month program. Which evaluation design best supports this claim?
- Post-only survey administered at program end
- Cross-sectional survey of current mentees
- Pre-post survey comparing baseline and follow-up scores (Correct answer)
- Focus group conducted after graduation
Correct answer: Pre-post survey comparing baseline and follow-up scores
A pre-post design captures change over time by comparing the same individuals before and after the mentoring intervention.
Question 3: When survey response rates fall below acceptable thresholds, what is the primary concern for mentoring program evaluators?
- Survey fatigue among administrators
- Non-response bias skewing results (Correct answer)
- Excessive cost of data collection
- Redundancy with other data sources
Correct answer: Non-response bias skewing results
Low response rates risk non-response bias, where those who did not respond may differ systematically from those who did, invalidating conclusions.
Question 4: Which qualitative method is most useful when a mentor wants to understand the *why* behind low satisfaction survey scores?
- Standardized achievement testing
- Follow-up interviews or focus groups (Correct answer)
- Larger sample randomized surveys
- Longitudinal cohort tracking
Correct answer: Follow-up interviews or focus groups
Interviews and focus groups allow participants to elaborate on their experiences, revealing reasons behind quantitative patterns.
Question 5: In Kirkpatrick's four-level evaluation model, Level 3 assesses:
- Participant satisfaction with the mentoring session
- Knowledge gained immediately after training
- Transfer of learning to on-the-job behavior (Correct answer)
- Organizational results and ROI
Correct answer: Transfer of learning to on-the-job behavior
Level 3 (Behavior) measures whether participants apply what they learned back in their work or personal context.
Question 6: A mentor program collects outcome data but never shares findings with stakeholders or adjusts the curriculum. This is an example of failing to:
- Maintain participant confidentiality
- Close the feedback loop (Correct answer)
- Use standardized measurement tools
- Obtain informed consent
Correct answer: Close the feedback loop
Closing the feedback loop means using evaluation findings to make program improvements and communicate results to relevant stakeholders.
Question 7: Which statistical measure is most appropriate for summarizing the central tendency of Likert-scale survey responses?
- Standard deviation
- Median or mode (Correct answer)
- Range
- Variance
Correct answer: Median or mode
Because Likert data is ordinal, the median (or mode for categorical responses) is the appropriate measure of central tendency rather than the mean.
CPM Outcome Evaluation & Surveys 2
Which type of survey scale asks respondents to rate their agreement on a 5- or 7-point scale from 'Strongly Disagree' to 'Strongly Agree'?