DSE - Data Science Supervised Learning: Classification Questions and Answers — Questions and Answers
Question 1: A data science team is developing a model to predict customer churn (whether a customer will leave or stay). The dataset is imbalanced, with a significantly smaller number of 'churn' instances. The business priority is to identify as many customers who are likely to churn as possible, even if it means some non-churning customers are incorrectly flagged. Which evaluation metric should the team primarily focus on optimizing?
- Accuracy
- Precision
- Recall (Sensitivity) (Correct answer)
- Specificity
Correct answer: Recall (Sensitivity)
Recall (or Sensitivity) is the most appropriate metric in this scenario because it measures the model's ability to correctly identify all actual positive cases (customers who churned). The formula is True Positives / (True Positives + False Negatives). Prioritizing recall is crucial when the cost of false negatives (failing to identify a churner) is high. Accuracy can be misleading in imbalanced datasets, and precision (which focuses on the correctness of positive predictions) is less important than capturing all potential churners.
Question 2: Which of the following is a key characteristic of classification problems in supervised learning?
- The model predicts a continuous numerical value.
- The training data is unlabeled.
- The model learns to group similar data points together.
- The target variable is categorical. (Correct answer)
Correct answer: The target variable is categorical.
In supervised learning, classification problems are defined by having a target variable that consists of a finite number of discrete categories or classes. The goal of the model is to learn a mapping from input features to predict the correct category for new, unseen data. Predicting a continuous value is a regression task, using unlabeled data is characteristic of unsupervised learning, and grouping similar data is clustering.
Question 3: A team has built a binary classification model and visualized its performance using a confusion matrix. The matrix shows the following: True Positives (TP) = 80, False Positives (FP) = 20, True Negatives (TN) = 450, False Negatives (FN) = 50. What is the precision of this model?
- 0.615
- 0.937
- 0.800 (Correct answer)
- 0.900
Correct answer: 0.800
Precision is calculated as the ratio of correctly predicted positive observations to the total predicted positive observations. The formula is TP / (TP + FP). In this case, Precision = 80 / (80 + 20) = 80 / 100 = 0.80. This means that when the model predicts the positive class, it is correct 80% of the time.
Question 4: Which of the following algorithms is NOT typically used for classification tasks?
- Logistic Regression
- K-Means Clustering (Correct answer)
- Support Vector Machines (SVM)
- Decision Trees
Correct answer: K-Means Clustering
K-Means Clustering is an unsupervised learning algorithm used for partitioning data into a set number of clusters based on feature similarity. It does not use labeled data to predict a categorical outcome. Logistic Regression, Support Vector Machines (SVM), and Decision Trees are all popular and powerful supervised learning algorithms used for classification.
Question 5: In the context of building a classification model, what is the primary purpose of a train/test split?
- To increase the size of the dataset by creating new data points.
- To train the model on the entire dataset for maximum accuracy.
- To ensure the features are on a similar scale before model training.
- To evaluate the model's performance on unseen data and check for overfitting. (Correct answer)
Correct answer: To evaluate the model's performance on unseen data and check for overfitting.
The dataset is split into a training set and a testing set. The model learns from the patterns in the training set. The test set, which the model has not been exposed to during training, is then used to provide an unbiased evaluation of how well the model generalizes to new, unseen data. This process is crucial for identifying overfitting, where a model performs well on training data but poorly on new data.
Question 6: A financial institution is building a model to detect fraudulent credit card transactions. A 'False Positive' in this context would mean:
- A fraudulent transaction is correctly identified as fraud.
- A legitimate transaction is incorrectly flagged as fraudulent. (Correct answer)
- A fraudulent transaction is missed and classified as legitimate.
- A legitimate transaction is correctly identified as legitimate.
Correct answer: A legitimate transaction is incorrectly flagged as fraudulent.
In this scenario, the 'positive' class is a fraudulent transaction. A False Positive occurs when the model incorrectly predicts the positive class. Therefore, a legitimate (negative class) transaction that is incorrectly flagged as fraudulent (positive class) is a False Positive.
DSE - Data Science Supervised Learning: Classification Questions and Answers
A data science team is developing a model to predict customer churn (whether a customer will leave or stay).
The dataset is imbalanced, with a significantly smaller number of 'churn' instances.
The business priority is to identify as many customers who are likely to churn as possible, even if it means some non-churning customers are incorrectly flagged.
Which evaluation metric should the team primarily focus on optimizing?