Solution Assessment & Validation Flashcards

After a solution has been in production for six months, the business analyst is asked to determine whether it delivered the expected business value. Which technique is MOST appropriate?

Answer: Post-implementation evaluation

Post-implementation evaluation (also called benefits realization review) systematically assesses whether the deployed solution has delivered the anticipated business value.

Which type of metric BEST measures whether a deployed solution is achieving its intended business outcomes?

Answer: Key performance indicators aligned to the original business objectives

KPIs tied to the original business objectives directly measure whether the solution is achieving the outcomes it was designed to deliver.

A BA discovers that a deployed solution meets all documented requirements but the business unit reports it has not improved their productivity. What is the MOST likely cause?

Answer: The requirements did not fully capture the underlying business need

When a solution meets requirements but fails to deliver business value, it typically indicates the requirements did not accurately capture the true underlying business need.

What is the PRIMARY difference between solution evaluation and solution validation?

Answer: Validation checks that requirements were met; evaluation assesses whether business value was delivered

Validation confirms the solution meets requirements, while evaluation (post-implementation) assesses whether the solution actually delivered the intended business value over time.

A BA is asked to assess a solution that underperforms against its defined KPIs. Which action should the BA take FIRST?

Answer: Analyze root causes to determine whether the issue lies with the solution, its implementation, or external factors

Root cause analysis must precede any recommendation, as underperformance could stem from solution defects, poor adoption, changed business conditions, or other factors.

Requirements traceability matrices are MOST useful during solution assessment because they:

Answer: Enable the BA to verify that every requirement has been addressed by the solution

A requirements traceability matrix maps each requirement to the solution components or test cases that address it, enabling systematic verification of coverage.

When a solution limitation is identified after deployment, the BA's recommended action should PRIMARILY focus on:

Answer: Assessing the impact of the limitation and identifying workarounds or improvements within existing constraints

The BA should assess impact and explore practical remediation options—workarounds, enhancements, or changes—before recommending more disruptive actions like replacement.