CVS Idea Evaluation and Selection Methods — Questions and Answers
Question 1: In a weighted evaluation matrix used during the VM Evaluation Phase, what is the primary purpose of assigning weights to evaluation criteria?
- To eliminate ideas that do not meet minimum cost thresholds
- To reflect the relative importance of each criterion to the project's value objectives (Correct answer)
- To ensure all team members contribute an equal number of scores
- To rank ideas alphabetically before scoring
Correct answer: To reflect the relative importance of each criterion to the project's value objectives
Weights in a weighted evaluation matrix represent how much each criterion matters relative to the others for the specific project. This ensures that more important objectives (e.g., maintainability over aesthetics) proportionally influence the final ranked scores.
Question 2: In a paired comparison analysis, how many comparisons are required to rank 5 ideas?
- 5
- 8
- 10 (Correct answer)
- 15
Correct answer: 10
Paired comparison requires comparing every idea against every other idea exactly once. The formula is n(n-1)/2, so for 5 ideas: 5×4/2 = 10 comparisons.
Question 3: Which of the following best describes the Kepner-Tregoe (KT) decision analysis approach when applied to VM idea evaluation?
- It ranks ideas solely by estimated cost savings in descending order
- It separates MUST criteria from WANT criteria, eliminating ideas that fail any MUST before scoring WANTS (Correct answer)
- It assigns equal weight to all criteria and averages team scores
- It uses Pareto analysis to select only the top 20% of ideas automatically
Correct answer: It separates MUST criteria from WANT criteria, eliminating ideas that fail any MUST before scoring WANTS
KT Decision Analysis first screens alternatives against 'MUST' (go/no-go) criteria — any idea failing a MUST is eliminated — then scores surviving ideas against weighted 'WANT' criteria. This two-step process is a structured, bias-resistant evaluation method.
Question 4: During the VM Evaluation Phase, a team scores 12 creative ideas against 4 weighted criteria. Which outcome BEST justifies advancing an idea to the Development Phase?
- The idea was suggested by the most senior stakeholder
- The idea received the highest weighted score AND does not violate any project constraints (Correct answer)
- The idea has the lowest implementation cost regardless of value impact
- The idea was generated first during the creativity phase
Correct answer: The idea received the highest weighted score AND does not violate any project constraints
Advancement to the Development Phase should be based on objective criteria: high weighted score indicates good alignment with project value objectives, and constraint compliance ensures feasibility. Neither seniority, cost alone, nor generation order is a sound basis.
Question 5: What is the recommended minimum number of ideas a VM team should evaluate before narrowing down to Development Phase candidates?
- 3–5 ideas
- All ideas generated, regardless of quantity (Correct answer)
- Only ideas pre-screened by the facilitator
- Ideas costing less than 10% of the baseline
Correct answer: All ideas generated, regardless of quantity
SAVE International's VM methodology requires that ALL ideas generated during the Creative Phase receive at least an initial screen during Evaluation to avoid premature elimination of high-value concepts. Filtering before evaluation defeats the purpose of divergent thinking.
Question 6: A VM team is evaluating 8 ideas but two team members have a strong bias toward one idea. Which evaluation technique MOST effectively mitigates this bias?
- Allowing the facilitator to cast a tie-breaking vote
- Using anonymous individual scoring followed by group discussion of score divergence (Correct answer)
- Removing the two biased members from the evaluation session
- Limiting the evaluation to three criteria to speed consensus
Correct answer: Using anonymous individual scoring followed by group discussion of score divergence
Anonymous individual scoring prevents groupthink and social pressure from distorting ratings. When individual scores are aggregated and divergences are then discussed openly, biases surface constructively without silencing any team member.
CVS Idea Evaluation and Selection Methods
In a weighted evaluation matrix used during the VM Evaluation Phase, what is the primary purpose of assigning weights to evaluation criteria?