Solution Evaluation and Validation Flashcards

What is the MAIN reason to conduct a solution evaluation BEFORE a solution is fully deployed?

Answer: To identify issues early enough to make cost-effective corrections before full deployment

Pre-deployment evaluation (through pilots, user acceptance testing, and controlled rollouts) identifies issues when they are least expensive to correct, avoiding costly post-deployment fixes.

Which of the following BEST describes 'organizational readiness assessment' in solution evaluation?

Answer: An assessment of whether the organization is prepared to absorb and sustain the proposed change

Organizational readiness assessment evaluates whether the organization has the capacity, capability, and willingness to absorb the change and sustain the new solution after implementation.

What should a business analyst do when evaluation reveals that the solution has achieved technical requirements but failed to deliver expected business outcomes?

Answer: Conduct further analysis to identify the gap between technical delivery and business outcome, and recommend corrective action

When a technical success fails to deliver business outcomes, the business analyst must investigate the gap — whether requirements were wrong, adoption is low, or additional changes are needed — and recommend corrective action.

What distinguishes 'formative evaluation' from 'summative evaluation' in solution validation?

Answer: Formative evaluation occurs during development to enable improvement; summative evaluation assesses outcomes after completion

Formative evaluation is ongoing during development, providing feedback that can shape and improve the solution; summative evaluation occurs after completion to assess final outcomes.

When a solution is validated against acceptance criteria, what does a 'pass' result indicate?

Answer: The solution meets the agreed criteria and can be formally accepted for intended use

A pass against acceptance criteria means the solution meets the conditions that stakeholders agreed in advance would make it acceptable for production use — it is formally ready for deployment.

Which business analysis technique is MOST useful for comparing expected vs. actual solution performance?

Answer: Variance analysis and KPI comparison against baseline measurements

Variance analysis compares actual performance metrics against expected (projected or baseline) metrics, directly revealing where the solution is over- or under-performing relative to expectations.