Chatbots Chatbot Analytics and Performance

Question 1

What does 'containment rate' measure in chatbot analytics?

Accepted Answer

The percentage of conversations fully resolved by the bot without requiring human escalation

Answer

Containment rate indicates how self-sufficient the chatbot is by showing what fraction of issues it resolves independently.

Question 2

What is 'intent coverage' as a chatbot performance metric?

Accepted Answer

The percentage of incoming user messages that match a defined intent versus triggering fallback

Answer

Intent coverage reveals whether the bot's training adequately addresses the range of topics users actually ask about.

Question 3

Which metric reveals how engaged users are within a chatbot session?

Accepted Answer

Messages per conversation — the average number of exchanges in a session

Answer

Messages per conversation indicates whether users are engaging in meaningful dialogue or abandoning the bot after one or two turns.

Question 4

What does a high 'fallback rate' indicate about a chatbot?

Accepted Answer

The bot frequently fails to understand user input and needs more training or broader intent coverage

Answer

A high fallback rate signals that users are asking questions the bot wasn't trained to handle, indicating training data gaps.

Question 5

How is 'user retention' measured in chatbot analytics?

Accepted Answer

By tracking how many users return to interact with the bot again after their first session

Answer

Retention shows whether the bot delivers enough value that users choose to engage with it again, signaling long-term usefulness.

Chatbots Practice Test