Chatbot Analytics and Performance Flashcards

What does 'containment rate' measure in chatbot analytics?

Answer: The percentage of conversations fully resolved by the bot without requiring human escalation

Containment rate indicates how self-sufficient the chatbot is by showing what fraction of issues it resolves independently.

What is 'intent coverage' as a chatbot performance metric?

Answer: The percentage of incoming user messages that match a defined intent versus triggering fallback

Intent coverage reveals whether the bot's training adequately addresses the range of topics users actually ask about.

Which metric reveals how engaged users are within a chatbot session?

Answer: Messages per conversation — the average number of exchanges in a session

Messages per conversation indicates whether users are engaging in meaningful dialogue or abandoning the bot after one or two turns.

What does a high 'fallback rate' indicate about a chatbot?

Answer: The bot frequently fails to understand user input and needs more training or broader intent coverage

A high fallback rate signals that users are asking questions the bot wasn't trained to handle, indicating training data gaps.

How is 'user retention' measured in chatbot analytics?

Answer: By tracking how many users return to interact with the bot again after their first session

Retention shows whether the bot delivers enough value that users choose to engage with it again, signaling long-term usefulness.

What is 'goal completion rate' in chatbot performance measurement?

Answer: The proportion of users who successfully accomplished the intended objective of the conversation

Goal completion rate directly measures business value by showing how often the chatbot achieves its designed purpose.