MS-DS Master of Data science FREE Master of Data science Big Data Questions and Answers 2

Question 1

Which distributed computing framework uses Resilient Distributed Datasets (RDDs) as its core data abstraction?

Accepted Answer

Apache Spark

Answer

Apache Spark uses RDDs as its fundamental data structure for fault-tolerant parallel processing.

Question 2

In the context of big data, what does the term 'data lake' primarily refer to?

Accepted Answer

A centralized repository storing raw data in its native format

Answer

A data lake stores vast amounts of raw data in its original format until it is needed for analysis.

Question 3

What is the primary purpose of Apache Kafka in a big data architecture?

Accepted Answer

Distributed event streaming and message brokering

Answer

Apache Kafka is designed as a distributed event streaming platform for high-throughput, real-time data pipelines.

Question 4

Which consistency model does the CAP theorem state cannot be fully achieved simultaneously with availability and partition tolerance?

Accepted Answer

Strong consistency

Answer

The CAP theorem states that a distributed system cannot simultaneously guarantee strong consistency, availability, and partition tolerance.

Question 5

What distinguishes columnar storage formats like Parquet from row-based storage in big data analytics?

Accepted Answer

Columnar formats enable faster analytical queries by reading only relevant columns

Answer

Columnar storage reads only the columns needed for a query, dramatically reducing I/O for analytical workloads.

MS-DS Master of Data science Practice Test