Product Management Product Metrics and Analytics 3

Question 1

What is 'A/B testing' used for in product management?

Accepted Answer

Comparing two versions of a feature to determine which performs better

Answer

A/B testing exposes different user segments to two variants of a feature or design and uses statistical analysis to determine which version achieves the desired outcome better.

Question 2

What is 'statistical significance' in the context of product experiments?

Accepted Answer

The probability that observed results are due to the change and not random chance

Answer

Statistical significance (typically p < 0.05) tells a PM that the difference between experiment variants is unlikely to be due to random variation.

Question 3

What is a 'funnel' in product analytics?

Accepted Answer

A sequence of steps users take toward a conversion goal, tracked to find drop-off points

Answer

A product funnel maps the steps from awareness to conversion, allowing PMs to identify which stages lose the most users and prioritize optimization.

Question 4

What does 'Monthly Recurring Revenue' (MRR) track?

Accepted Answer

Predictable subscription revenue normalized to a monthly amount

Answer

MRR is the cornerstone SaaS revenue metric representing the predictable, recurring portion of revenue earned each month from active subscriptions.

Question 5

What is 'retention rate' and how does it differ from churn rate?

Accepted Answer

Retention rate measures users who stay; churn rate measures users who leave — they are inverses

Answer

Retention rate and churn rate are complementary metrics: if churn is 5%, retention is 95%, providing two lenses on the same user staying behavior.

Product Management Practice Test

Product Management Practice Test

Product Management Product Metrics and Analytics 3