CPM Metrics and Analytics 2 — Questions and Answers
Question 1: What is cohort analysis primarily used for in product management?
- Comparing the performance of different product features side-by-side
- Tracking the behavior of groups of users who share a common characteristic over time (Correct answer)
- Measuring the speed of the product's backend infrastructure
- Analyzing competitor pricing strategies
Correct answer: Tracking the behavior of groups of users who share a common characteristic over time
Cohort analysis groups users by a shared characteristic (e.g., signup date) and tracks their behavior over time, enabling PMs to identify trends in retention, engagement, or revenue.
Question 2: What is the key difference between leading and lagging indicators in product metrics?
- Leading indicators are financial; lagging indicators are behavioral
- Leading indicators predict future outcomes; lagging indicators measure past results (Correct answer)
- Leading indicators are qualitative; lagging indicators are quantitative
- Leading indicators come from surveys; lagging indicators come from usage data
Correct answer: Leading indicators predict future outcomes; lagging indicators measure past results
Leading indicators (e.g., feature adoption, engagement) predict future performance, while lagging indicators (e.g., revenue, churn) confirm outcomes that have already occurred.
Question 3: What does the AARRR (Pirate Metrics) framework stand for?
- Awareness, Adoption, Retention, Revenue, Referral
- Acquisition, Activation, Retention, Revenue, Referral (Correct answer)
- Acquisition, Analytics, Retention, Revenue, Reach
- Awareness, Activation, Reach, Revenue, Referral
Correct answer: Acquisition, Activation, Retention, Revenue, Referral
AARRR stands for Acquisition, Activation, Retention, Revenue, and Referral — a funnel framework developed by Dave McClure to track the full user lifecycle.
Question 4: What does Customer Lifetime Value (CLV or LTV) represent?
- The total cost to acquire a single customer
- The predicted total net revenue a business expects from a customer over the entire relationship (Correct answer)
- The average number of months a customer uses the product
- The maximum amount a customer has ever paid in a single transaction
Correct answer: The predicted total net revenue a business expects from a customer over the entire relationship
CLV represents the total revenue a business can reasonably expect from a single customer account throughout their entire relationship, guiding acquisition spend and retention investment.
Question 5: What is the primary purpose of A/B testing in product management?
- To compare the performance of two competing products in the market
- To test two variants of a feature or design with real users to determine which performs better (Correct answer)
- To benchmark product performance against industry standards
- To evaluate two different pricing models with potential investors
Correct answer: To test two variants of a feature or design with real users to determine which performs better
A/B testing (split testing) exposes different user groups to two variants simultaneously and uses statistical analysis to determine which version produces better outcomes.
Question 6: What does 'Time to Value' (TTV) measure in a SaaS product context?
- The time it takes for a customer to pay their first invoice
- The time elapsed between a user signing up and experiencing the product's core value for the first time (Correct answer)
- The average time users spend on the platform per session
- The duration of a typical sales cycle from lead to close
Correct answer: The time elapsed between a user signing up and experiencing the product's core value for the first time
Time to Value measures how quickly a new user reaches the 'aha moment' — the point where they experience the core value of the product — which is critical for reducing early churn.
Question 7: What does funnel analysis help product managers understand?
- The geographical distribution of the user base
- Where users drop off across a defined sequence of steps toward a goal (Correct answer)
- The social media channels driving the most traffic
- The technical performance of each product feature
Correct answer: Where users drop off across a defined sequence of steps toward a goal
Funnel analysis tracks how users progress through a multi-step process (e.g., onboarding, purchase) and identifies the steps with the highest drop-off rates that require optimization.
CPM Metrics and Analytics 2
What is cohort analysis primarily used for in product management?