Product Management Certification Program Product Management Certification Chapter 5 — Questions and Answers
Question 1: Which type of A/B test result should make a PM MOST cautious about declaring a winner?
- A result with p < 0.01 and large sample size
- A result that shows a conversion lift but a simultaneous drop in retention (Correct answer)
- A result where both variants performed identically
- A result achieved after 4 weeks of testing
Correct answer: A result that shows a conversion lift but a simultaneous drop in retention
Optimizing one metric at the expense of another (e.g., conversions vs. retention) can create short-term gains that damage long-term business health.
Question 2: What is the purpose of an 'assumption map' in product discovery?
- To document all technical dependencies for engineering
- To surface and prioritize the riskiest assumptions underlying a product bet before building (Correct answer)
- To assign team members to each feature assumption
- To track which features were assumed by stakeholders vs. users
Correct answer: To surface and prioritize the riskiest assumptions underlying a product bet before building
An assumption map helps teams identify which beliefs about users, value, and feasibility carry the most risk and deserve early validation.
Question 3: A PM is launching a product in a new market segment. Which go-to-market element is MOST critical to define first?
- The advertising channel mix
- The ideal customer profile (ICP) and their core pain point (Correct answer)
- The product pricing tier
- The launch date and press release
Correct answer: The ideal customer profile (ICP) and their core pain point
Without a clear ICP, messaging, channel selection, and pricing lack the targeting precision needed for an effective launch.
Question 4: In dual-track Agile, what runs simultaneously with the delivery track?
- A separate QA track
- A discovery track where the team continuously validates new ideas (Correct answer)
- A marketing launch track
- A technical debt reduction track
Correct answer: A discovery track where the team continuously validates new ideas
Dual-track Agile separates continuous discovery (validating what to build) from continuous delivery (building validated items), ensuring the team always has proven work to ship.
Question 5: What does a 'swim lane' roadmap communicate that a timeline roadmap does not?
- Exact delivery dates for each feature
- How initiatives are organized across multiple themes, teams, or customer segments simultaneously (Correct answer)
- The technical dependencies between features
- The cost estimate for each roadmap item
Correct answer: How initiatives are organized across multiple themes, teams, or customer segments simultaneously
Swim lane roadmaps show parallel workstreams visually, making it easy to see how different teams or priorities progress at the same time.
Question 6: Which approach BEST describes 'continuous discovery' in modern product management?
- Running a large annual user research study to inform the yearly roadmap
- Conducting small, frequent touchpoints with customers every week to continuously inform product decisions (Correct answer)
- Outsourcing user research to a third-party firm
- Reviewing customer support tickets once per quarter
Correct answer: Conducting small, frequent touchpoints with customers every week to continuously inform product decisions
Continuous discovery, popularized by Teresa Torres, embeds weekly user touchpoints so teams make decisions with fresh, real customer insight rather than stale research.
Question 7: A PM's product has strong acquisition metrics but poor 30-day retention. Which framework BEST helps diagnose the problem?
- Porter's Five Forces
- The Pirate Metrics (AARRR) funnel, focusing on the Activation stage (Correct answer)
- SWOT Analysis
- BCG Growth-Share Matrix
Correct answer: The Pirate Metrics (AARRR) funnel, focusing on the Activation stage
When acquisition is strong but retention is poor, the problem typically lies in Activation — users aren't reaching the 'aha moment' before churning.
Product Management Certification Program Product Management Certification Chapter 5
Which type of A/B test result should make a PM MOST cautious about declaring a winner?