CPT Data Analysis & Reporting 3 — Questions and Answers
Question 1: A CPT is reviewing a report where the y-axis of a bar chart starts at 75% instead of 0%. What is the MAIN concern with this design choice?
- It makes small differences appear larger than they are (Correct answer)
- It prevents the use of color coding
- It removes the ability to show trend lines
- It violates statistical significance standards
Correct answer: It makes small differences appear larger than they are
Truncating the y-axis exaggerates visual differences, potentially misleading stakeholders about the magnitude of change.
Question 2: When using Kirkpatrick's Level 3 data to report behavior change, which data source provides the STRONGEST evidence?
- Self-report surveys completed immediately after training
- 360-degree feedback collected 90 days post-training (Correct answer)
- Pre-training knowledge assessment scores
- Attendance records from the training session
Correct answer: 360-degree feedback collected 90 days post-training
360-degree feedback gathered 90 days post-training captures observable on-the-job behavior change from multiple raters over time.
Question 3: A performance technologist is asked to present data showing ROI for a leadership program. Which formula correctly represents ROI?
- (Net Benefits / Program Costs) × 100 (Correct answer)
- (Total Benefits / Net Benefits) × 100
- (Program Costs / Net Benefits) × 100
- (Net Benefits − Program Costs) × 100
Correct answer: (Net Benefits / Program Costs) × 100
ROI is calculated as (Net Benefits divided by Program Costs) multiplied by 100 to express the return as a percentage.
Question 4: A CPT wants to track whether a new onboarding process reduces time-to-proficiency over 12 months. Which chart type BEST displays this longitudinal trend?
- Stacked bar chart
- Line chart (Correct answer)
- Pie chart
- Scatter plot
Correct answer: Line chart
Line charts are ideal for showing changes in a variable over sequential time periods, making trends easy to identify.
Question 5: Which approach BEST reduces response bias in a post-training survey designed to evaluate a mandatory compliance program?
- Require employees to sign the survey with their name
- Use anonymized responses with aggregate reporting only (Correct answer)
- Administer the survey immediately before the program ends
- Limit survey questions to yes/no format
Correct answer: Use anonymized responses with aggregate reporting only
Anonymizing responses reduces social desirability bias, encouraging honest feedback about mandatory programs.
Question 6: A CPT receives performance data where 5% of values are extreme outliers caused by data entry errors. What is the BEST initial action?
- Include all values to preserve data integrity
- Delete all records that contain any error
- Clean the data by correcting or excluding confirmed erroneous values (Correct answer)
- Replace outliers with the dataset mean automatically
Correct answer: Clean the data by correcting or excluding confirmed erroneous values
Confirmed data entry errors should be corrected or excluded through a documented cleaning process to ensure analytical accuracy.
Question 7: In which situation is a control group MOST critical for drawing valid causal conclusions from performance data?
- When reporting aggregate attendance statistics
- When determining whether a training intervention caused performance improvement (Correct answer)
- When summarizing employee satisfaction scores
- When calculating cost-per-learner metrics
Correct answer: When determining whether a training intervention caused performance improvement
A control group that receives no intervention allows attribution of performance changes to the training itself rather than other factors.
CPT Data Analysis & Reporting 3
A CPT is reviewing a report where the y-axis of a bar chart starts at 75% instead of 0%.
What is the MAIN concern with this design choice?