MS-DS Master of Data science Master of Data science Big Data 1

Question 1

Which file format is optimized for columnar storage and is commonly used in big data ecosystems for efficient query performance?

Accepted Answer

Parquet

Answer

CSV

Answer

JSON

Answer

XML

Question 2

In the Lambda architecture for big data processing, which layer handles real-time data processing with low latency?

Accepted Answer

Speed layer

Answer

Batch layer

Answer

Serving layer

Answer

Storage layer

Question 3

Which algorithm is commonly used for distributed machine learning to split gradient computation across multiple nodes?

Accepted Answer

Distributed Gradient Boosting

Answer

K-Means clustering

Answer

Stochastic Gradient Descent

Answer

Principal Component Analysis

Question 4

What is the primary role of Apache ZooKeeper in a big data cluster?

Accepted Answer

Distributed coordination and configuration management

Answer

Data serialization

Answer

In-memory caching

Answer

ETL pipeline orchestration

Question 5

Which concept in big data describes the phenomenon where storing and processing costs decrease as the volume of data increases per unit?

Accepted Answer

Economies of scale

Answer

Data gravity

Answer

Data sparsity

Answer

Horizontal sharding

Question 6

In Apache Spark, which operation triggers the actual execution of a transformation chain on an RDD or DataFrame?

Accepted Answer

collect()

Answer

map()

Answer

filter()

Answer

flatMap()