FREE MS-DS Master of Data science Data Wrangling and Preprocessing Questions and Answers

Question 1

A data scientist is preparing a dataset for a machine learning model that is sensitive to the scale of its input features, such as K-Nearest Neighbors. The dataset contains two numerical features: 'Age' (ranging from 20 to 70) and 'Income' (ranging from 30,000 to 150,000). Which of the following preprocessing techniques is most appropriate to apply to these features?

Accepted Answer

Normalization (Min-Max Scaling)

Answer

Normalization, or Min-Max Scaling, rescales features to a fixed range, typically [0, 1]. [9, 13] This is crucial for distance-based algorithms like K-Nearest Neighbors, where features with larger ranges (like 'Income') could otherwise dominate the distance calculations and unduly influence the model's predictions. [7, 8] Standardization centers the data around a mean of 0 and a standard deviation of 1 but doesn't bound it to a specific range, which can be less ideal for algorithms that are highly sensitive to the magnitude of feature values. One-Hot Encoding is for categorical data, and Log Transformation is for handling skewed distributions.

Question 2

You are working with a customer dataset that includes a 'Subscription Level' feature with the categories: 'Bronze', 'Silver', 'Gold', and 'Platinum'. There is a clear hierarchical order to these categories. Which encoding method would be most suitable and efficient for this feature before using it in a machine learning model?

Accepted Answer

Label Encoding

Answer

Label Encoding is ideal for ordinal categorical data where there is an intrinsic, meaningful order among the categories ('Bronze' < 'Silver' < 'Gold' < 'Platinum'). [2] It assigns a unique integer to each category (e.g., 0, 1, 2, 3), preserving the ordinal relationship while being memory-efficient. [3] One-Hot Encoding would be more appropriate for nominal data (no inherent order) but would create unnecessary extra columns and lose the ordinal information. [20]

Question 3

A dataset containing sensor readings has missing values in a 'Temperature' column. The data is missing completely at random (MCAR), and the overall temperature distribution is not heavily skewed. To handle the missing data, a data scientist decides to use an imputation method. Which of the following is a simple, yet reasonable, imputation strategy in this scenario?

Accepted Answer

Replace missing values with the mean of the 'Temperature' column

Answer

For numerical data that is missing completely at random and has a symmetric distribution, mean imputation is a straightforward and common technique. [17, 22] It replaces the missing values with the average of the observed values, which can be a reasonable estimate that doesn't significantly distort the overall distribution. [18] Deleting rows can lead to a significant loss of information, and replacing with a constant can introduce bias. KNN Imputation is a more complex method that, while powerful, might be unnecessarily complex for this simple case.

Question 4

Which of the following data wrangling tasks is primarily aimed at reducing the dimensionality of the dataset while retaining as much of the original variance as possible?

Accepted Answer

Principal Component Analysis (PCA)

Answer

Principal Component Analysis (PCA) is a dimensionality reduction technique used to transform a set of correlated features into a smaller set of uncorrelated features called principal components. The goal of PCA is to capture the maximum possible variance from the original features in the first few principal components, thereby reducing the number of features with minimal loss of information. [33] The other options address different preprocessing needs: outlier removal, feature scaling, and data summarization.

Question 5

A data scientist is analyzing a dataset of house prices and notices that the 'LotArea' feature is highly right-skewed. To prepare this feature for a linear regression model, which assumes a more normal distribution of variables, what is the most appropriate transformation to apply?

Accepted Answer

Log Transformation

Answer

Log transformation is a common and effective method for handling right-skewed data. [21] By taking the logarithm of the values, it compresses the range of the larger values more than the smaller values, which can help make the distribution more symmetric and closer to a normal distribution. This is beneficial for linear models that perform better when variables are normally distributed. Standardization changes the mean and standard deviation but does not correct for skewness. One-hot encoding and binning are not suitable for this purpose.

MS-DS Master of Data science Practice Test

MS-DS Master of Data science Practice Test

FREE MS-DS Master of Data science Data Wrangling and Preprocessing Questions and Answers