ADE ADE Cloud & Big Data Technologies

Question 1

Which AWS service is commonly used as a managed Hadoop and Spark cluster for big data processing?

Accepted Answer

Amazon EMR

Answer

Amazon EMR (Elastic MapReduce) is the AWS managed service for running Apache Hadoop and Spark clusters for big data workloads.

Question 2

In Apache Spark, what is the primary distributed data structure used for in-memory processing?

Accepted Answer

RDD

Answer

The Resilient Distributed Dataset (RDD) is Spark's fundamental distributed data abstraction enabling fault-tolerant in-memory parallel computation.

Question 3

Which cloud storage format is optimized for analytical queries due to its columnar storage layout?

Accepted Answer

Parquet

Answer

Parquet is a columnar storage format designed for efficient analytical queries, reducing I/O by reading only relevant columns.

Question 4

What is the purpose of a data lake in a modern cloud architecture?

Accepted Answer

To serve as a central repository for raw data in any format

Answer

A data lake stores raw data in any format (structured, semi-structured, unstructured) at scale, enabling flexible downstream processing.

Question 5

Which GCP service provides a fully managed, serverless big data query engine for analyzing data stored in Google Cloud Storage?

Accepted Answer

BigQuery

Answer

BigQuery is Google's fully managed, serverless data warehouse that supports SQL analytics over petabyte-scale datasets stored in GCS.

ADE - Associate Data Engineer Certification Practice Test