MS-DS Master of Data science FREE Master of Data science Big Data Questions and Answers 3

Question 1

Which big data processing paradigm is best suited for computing results over unbounded, continuously arriving data?

Accepted Answer

Stream processing

Answer

Stream processing handles continuous, unbounded data flows in real time or near-real time.

Question 2

What is the primary function of YARN in the Hadoop ecosystem?

Accepted Answer

Cluster resource management and job scheduling

Answer

YARN (Yet Another Resource Negotiator) manages cluster resources and schedules applications across the Hadoop cluster.

Question 3

Which data partitioning strategy assigns rows to partitions based on a hash function applied to a key column?

Accepted Answer

Hash partitioning

Answer

Hash partitioning applies a hash function to a key to evenly distribute data across partitions.

Question 4

What problem does the concept of 'data skew' cause in distributed big data processing?

Accepted Answer

Uneven workload distribution causing some nodes to become bottlenecks

Answer

Data skew causes certain partitions to hold disproportionately more data, creating processing bottlenecks on those nodes.

Question 5

In a Lambda architecture for big data, what is the role of the speed layer?

Accepted Answer

Providing low-latency views of recent data not yet processed by the batch layer

Answer

The speed layer compensates for the batch layer's latency by processing recent data in real time.

MS-DS Master of Data science Practice Test