DSE Big Data Technologies 2

Question 1

Which component of the Hadoop ecosystem is responsible for distributed storage?

Accepted Answer

HDFS

Answer

HDFS (Hadoop Distributed File System) is the storage layer that splits files into blocks and distributes them across cluster nodes.

Question 2

In Apache Kafka, what is a 'consumer group' used for?

Accepted Answer

Allowing multiple consumers to read different partitions in parallel

Answer

A consumer group lets multiple consumers divide the partitions of a topic among themselves, enabling parallel and scalable consumption.

Question 3

What does the CAP theorem state about distributed systems?

Accepted Answer

You can guarantee at most two of Consistency, Availability, and Partition tolerance

Answer

The CAP theorem states that a distributed system can guarantee only two of the three properties: Consistency, Availability, and Partition tolerance.

Question 4

Which Apache project provides a SQL-like interface for querying data stored in HDFS?

Accepted Answer

Hive

Answer

Apache Hive provides HiveQL, a SQL-like language that translates queries into MapReduce or Tez jobs over HDFS data.

Question 5

In Spark, what is the primary advantage of using DataFrames over RDDs?

Accepted Answer

DataFrames enable Catalyst optimizer and Tungsten execution engine optimizations

Answer

DataFrames expose schema information that allows Spark's Catalyst optimizer and Tungsten execution engine to apply significant performance optimizations.

DSE - Data Science Practice Test

DSE - Data Science Practice Test

DSE Big Data Technologies 2