Grant Writing Project Evaluation and Metrics 5 â Questions and Answers
Question 1: Which of the following scenarios represents a 'fidelity' concern in program evaluation?
- Participants dropping out before completing the program
- Staff delivering only half of the required curriculum sessions (Correct answer)
- The funder reducing the grant award mid-year
- Data being submitted one week late
Correct answer: Staff delivering only half of the required curriculum sessions
Fidelity refers to whether the program was implemented as designed; delivering only half the curriculum means the model was not followed with fidelity.
Question 2: A federal grant requires use of a 'common measure' across all grantees. What is the purpose of this requirement?
- To reduce the paperwork burden on individual grantees
- To enable cross-site comparisons and aggregate impact data across the portfolio (Correct answer)
- To eliminate the need for site-specific evaluation plans
- To standardize grant budgets across all awards
Correct answer: To enable cross-site comparisons and aggregate impact data across the portfolio
Common measures allow funders to aggregate data across multiple grantees to assess the overall impact of a funding initiative.
Question 3: An external evaluator's independence is most important for which aspect of credibility?
- Reducing the cost of data collection
- Minimizing the risk of bias in data interpretation and reporting (Correct answer)
- Ensuring the evaluation is completed on time
- Increasing participant response rates on surveys
Correct answer: Minimizing the risk of bias in data interpretation and reporting
An external evaluator is not affiliated with the program, which reduces the risk that findings will be shaped by the desire to show positive results.
Question 4: In evaluation reporting, 'triangulation' means:
- Using three evaluation staff members to review each report
- Comparing findings from multiple data sources or methods to increase confidence in conclusions (Correct answer)
- Dividing the evaluation timeline into three equal phases
- Having three funders co-review the final report
Correct answer: Comparing findings from multiple data sources or methods to increase confidence in conclusions
Triangulation uses multiple data sources or methods to cross-check findings, strengthening confidence that results reflect reality.
Question 5: A grantee collects excellent evaluation data but fails to use findings to improve the program. This gap is known as:
- Data saturation
- Underutilization of evaluation findings (Correct answer)
- Summative evaluation failure
- Logic model misalignment
Correct answer: Underutilization of evaluation findings
Evaluation useâapplying findings to program decisionsâis the ultimate purpose of evaluation; collecting data without acting on it represents a common and critical gap.
Question 6: Which of the following is the best indicator that a nonprofit has strong evaluation infrastructure?
- They hire an external evaluator for every grant they receive
- Staff routinely collect, review, and act on performance data between reporting deadlines (Correct answer)
- They submit all required reports on time
- They use the same survey instrument for every program they run
Correct answer: Staff routinely collect, review, and act on performance data between reporting deadlines
Strong evaluation infrastructure means evaluation is embedded in daily operationsâstaff use data continuously, not just when a funder requires a report.
Question 7: A funder's RFP asks applicants to describe how they will ensure 'data quality.' Which practice best addresses this?
- Submitting data reports in PDF format
- Implementing data validation checks, staff training on data entry, and regular audits of records (Correct answer)
- Collecting data only from program completers
- Using the same data collection form as a peer organization
Correct answer: Implementing data validation checks, staff training on data entry, and regular audits of records
Data quality requires systematic practicesâvalidation rules, trained staff, and auditsâto ensure data is accurate, complete, and consistent.
Grant Writing Project Evaluation and Metrics 5
Which of the following scenarios represents a 'fidelity' concern in program evaluation?