Web Analytics Conversion Rate Optimization 2 — Questions and Answers
Question 1: What is a 'multivariate test' (MVT) compared to an A/B test?
- An MVT tests one variable at a time
- An MVT tests multiple variables simultaneously to find the best combination (Correct answer)
- An MVT uses qualitative data only
- An MVT runs on mobile only
Correct answer: An MVT tests multiple variables simultaneously to find the best combination
MVT simultaneously tests multiple page elements (headline, image, CTA) to identify the best-performing combination.
Question 2: What does 'cart abandonment rate' measure in e-commerce analytics?
- Percentage of users who never viewed a product
- Percentage of users who added items to cart but did not complete purchase (Correct answer)
- Average items left in cart per session
- Revenue lost per abandoned cart
Correct answer: Percentage of users who added items to cart but did not complete purchase
Cart abandonment rate is the percentage of shoppers who add items to their cart but leave before completing the checkout.
Question 3: What is 'form analytics' in the context of CRO?
- Tracking form server errors only
- Analyzing user interactions with web forms to identify friction and drop-off fields (Correct answer)
- Monitoring form submission spam rates
- A/B testing form colors
Correct answer: Analyzing user interactions with web forms to identify friction and drop-off fields
Form analytics tools track field-level interactions—time spent, corrections, and abandonment—to pinpoint which form fields cause drop-offs.
Question 4: Which metric directly measures how effectively a page turns visitors into leads or customers?
- Bounce rate
- Conversion rate (Correct answer)
- Exit rate
- Session duration
Correct answer: Conversion rate
Conversion rate directly measures the percentage of visitors who complete the desired action, making it the core CRO performance metric.
Question 5: What is 'uplift' in the context of A/B testing results?
- The increase in page load speed
- The percentage improvement of the variation over the control (Correct answer)
- The number of additional sessions in the test
- The confidence interval of the test
Correct answer: The percentage improvement of the variation over the control
Uplift is the relative percentage improvement in the conversion rate of the variation compared to the control.
Question 6: What is the 'novelty effect' and why does it matter in CRO testing?
- When new users convert more than returning users
- When a variation performs well initially because it is new, not because it is better (Correct answer)
- When a new analytics tool shows inflated metrics
- When a new product launches and traffic spikes
Correct answer: When a variation performs well initially because it is new, not because it is better
The novelty effect causes a temporary lift in a variation's performance simply because it is unfamiliar, which can fade over time.
Web Analytics Conversion Rate Optimization 2
What is a 'multivariate test' (MVT) compared to an A/B test?