PCB PCB Data Analysis & Reporting 2 — Questions and Answers
Question 1: A control group in PCB program evaluation serves to:
- Receive the most intensive services
- Provide a comparison baseline to determine whether observed changes are due to the program (Correct answer)
- Monitor program fidelity
- Document client grievances
Correct answer: Provide a comparison baseline to determine whether observed changes are due to the program
A control group that does not receive the intervention allows evaluators to attribute changes in the treatment group to the program rather than to external factors.
Question 2: Which of the following is an example of qualitative data in PCB evaluation?
- Number of clients who completed the program
- Percentage scoring above a threshold on a standardized instrument
- Client narratives describing how the program affected their family relationships (Correct answer)
- Average number of sessions attended per client
Correct answer: Client narratives describing how the program affected their family relationships
Qualitative data consists of non-numerical information such as narratives, themes, and descriptions that capture depth of experience.
Question 3: A PCB program's data dashboard should primarily display:
- Raw data tables exported from the database
- Key performance indicators aligned with program goals, presented in accessible visual formats (Correct answer)
- All data collected, without filtering
- Staff attendance and payroll information
Correct answer: Key performance indicators aligned with program goals, presented in accessible visual formats
Effective dashboards highlight the most decision-relevant metrics in clear visual formats to support timely program management.
Question 4: In PCB reporting, attrition bias occurs when:
- Staff members leave the organization during the program
- Participants who drop out of a study differ systematically from those who remain, skewing results (Correct answer)
- Data entry errors cause inaccurate counts
- Too few clients are enrolled to meet the program's capacity
Correct answer: Participants who drop out of a study differ systematically from those who remain, skewing results
If dropouts differ from completers in important ways, final outcomes overestimate or underestimate true program effects for the full enrolled population.
Question 5: In PCB program evaluation, a validated instrument is preferred over an internally developed tool because:
- It costs less to administer
- Its reliability and validity have been established through rigorous testing in relevant populations (Correct answer)
- It requires less staff training to use
- It avoids the need for IRB approval
Correct answer: Its reliability and validity have been established through rigorous testing in relevant populations
Validated instruments have demonstrated psychometric properties (reliability and validity) ensuring they measure what they claim to measure consistently.
Question 6: Return on investment (ROI) analysis in PCB programs is calculated by:
- Dividing total revenue by number of clients served
- Comparing the monetary value of program benefits to the costs of delivering the program (Correct answer)
- Measuring staff satisfaction relative to salary expenditure
- Tracking the percentage of clients who return for additional services
Correct answer: Comparing the monetary value of program benefits to the costs of delivering the program
ROI analysis quantifies whether the financial and social value generated by a program exceeds its delivery costs, supporting resource allocation decisions.
A control group in PCB program evaluation serves to: