Product Management Certification Program Product Management Definition & Tools Certification 4 — Questions and Answers
Question 1: Which metric is most appropriate for measuring the success of a feature designed to improve user retention?
- Customer Acquisition Cost (CAC)
- Daily Active Users (DAU) or 30-day retention rate (Correct answer)
- Gross Merchandise Volume (GMV)
- Net Promoter Score (NPS) at sign-up
Correct answer: Daily Active Users (DAU) or 30-day retention rate
Retention-focused features are best evaluated with metrics like DAU trends or cohort retention rates that directly measure whether users return.
Question 2: What is a 'North Star Metric' in product management?
- The most important KPI that reflects the core value a product delivers to customers (Correct answer)
- The leading metric used only in executive board presentations
- The total number of users acquired in a given period
- A metric tracked only during product launch phases
Correct answer: The most important KPI that reflects the core value a product delivers to customers
The North Star Metric is a single key metric that best captures the core value delivered to customers and serves as a compass for the entire team.
Question 3: When building a product roadmap using the 'Now-Next-Later' format, what does the 'Later' column typically represent?
- Work scheduled for the next two-week sprint
- Ideas and opportunities that are on the horizon but not yet committed to (Correct answer)
- Features that have been deprioritized permanently
- Technical debt items assigned to the infrastructure team
Correct answer: Ideas and opportunities that are on the horizon but not yet committed to
The 'Later' column holds strategic bets and exploratory ideas that aren't planned for near-term delivery but are worth tracking.
Question 4: A product team runs an A/B test on a new checkout flow. The variant increases conversions by 8% with a p-value of 0.03. What should the PM conclude?
- The result is inconclusive because the sample size is too small
- The variant is statistically significant and should be shipped (Correct answer)
- The test needs to run for at least six more months to be valid
- An 8% lift is too small to be practically significant
Correct answer: The variant is statistically significant and should be shipped
A p-value of 0.03 (below the standard 0.05 threshold) indicates statistical significance, supporting the decision to ship the variant.
Question 5: Which statement best describes 'continuous discovery' in modern product management?
- Running one large annual user research study to inform the yearly roadmap
- An ongoing practice of regularly engaging with customers to inform product decisions throughout development (Correct answer)
- Continuously shipping new features to discover what users like
- Automating A/B tests to eliminate the need for qualitative research
Correct answer: An ongoing practice of regularly engaging with customers to inform product decisions throughout development
Continuous discovery, popularized by Teresa Torres, means regularly touching base with customers (e.g., weekly) to keep product decisions grounded in real user needs.
Question 6: What is the primary purpose of a 'Product Requirements Document' (PRD)?
- To document the technical architecture and system design
- To communicate what a product feature should do and why, for all stakeholders (Correct answer)
- To track bug reports and QA test cases
- To outline the marketing strategy for a product launch
Correct answer: To communicate what a product feature should do and why, for all stakeholders
A PRD defines the purpose, features, behavior, and success criteria of a product or feature, aligning engineering, design, and business stakeholders.
Question 7: A PM uses a 'Swimlane Diagram' during planning. What is this tool primarily used for?
- Visualizing cash flow across product lines
- Mapping process flows with clear ownership assigned to different teams or roles (Correct answer)
- Tracking user swim patterns in UX research
- Showing feature dependencies across sprints in a Gantt format
Correct answer: Mapping process flows with clear ownership assigned to different teams or roles
Swimlane Diagrams organize process steps into horizontal or vertical lanes, each representing a team or role responsible for those steps.
Product Management Certification Program Product Management Definition & Tools Certification 4
Which metric is most appropriate for measuring the success of a feature designed to improve user retention?