Data Analysis & Interpretation Techniques Flashcards

What is the primary purpose of excluding internal traffic from analysis?

Answer: To prevent employee activity from distorting user behavior metrics

Internal visits don't reflect real customer behavior and can skew engagement and conversion data.

Which statement about statistical significance is correct?

Answer: It indicates the observed difference is unlikely to be due to chance alone

Significance addresses the likelihood of chance, not the business importance or causation of an effect.

An analyst notices new users convert at 1.5% and returning users at 4%. What is the most useful next step?

Answer: Investigate what drives returning-user conversion and how to nurture new users toward it

Segment differences should prompt investigation of drivers and tailored strategies per segment.

What is survivorship bias in web analytics?

Answer: Analyzing only users who completed a path while ignoring those who dropped off

Focusing only on those who 'survived' to a point hides why others left and skews conclusions.

When benchmarking your site against industry averages, what is the main caution?

Answer: Differences in audience, business model, and measurement can make benchmarks not directly comparable

Benchmarks vary in definition and context, so they should guide rather than dictate conclusions.

Which visualization is best for showing a metric's change over time to identify trends?

Answer: Line chart

Line charts clearly depict continuous change across time periods and highlight trends.

Referral spam appearing in reports most directly affects interpretation by doing what?

Answer: Inflating sessions and distorting engagement metrics for a source

Fake referral hits add low-quality sessions that skew source, bounce, and engagement analysis.