ADE ADE Cloud & Big Data Technologies 1 — Questions and Answers
Question 1: Which AWS service is commonly used as a managed Hadoop and Spark cluster for big data processing?
- Amazon Redshift
- Amazon EMR (Correct answer)
- Amazon Kinesis
- Amazon Glue
Correct answer: Amazon EMR
Amazon EMR (Elastic MapReduce) is the AWS managed service for running Apache Hadoop and Spark clusters for big data workloads.
Question 2: In Apache Spark, what is the primary distributed data structure used for in-memory processing?
- DataFrame
- RDD (Correct answer)
- Dataset
- DStream
Correct answer: RDD
The Resilient Distributed Dataset (RDD) is Spark's fundamental distributed data abstraction enabling fault-tolerant in-memory parallel computation.
Question 3: Which cloud storage format is optimized for analytical queries due to its columnar storage layout?
- CSV
- JSON
- Parquet (Correct answer)
- XML
Correct answer: Parquet
Parquet is a columnar storage format designed for efficient analytical queries, reducing I/O by reading only relevant columns.
Question 4: What is the purpose of a data lake in a modern cloud architecture?
- To store only structured relational data
- To serve as a central repository for raw data in any format (Correct answer)
- To replace the data warehouse entirely
- To cache frequently accessed data for low-latency reads
Correct answer: To serve as a central repository for raw data in any format
A data lake stores raw data in any format (structured, semi-structured, unstructured) at scale, enabling flexible downstream processing.
Question 5: Which GCP service provides a fully managed, serverless big data query engine for analyzing data stored in Google Cloud Storage?
- Cloud Spanner
- Cloud Bigtable
- BigQuery (Correct answer)
- Dataflow
Correct answer: BigQuery
BigQuery is Google's fully managed, serverless data warehouse that supports SQL analytics over petabyte-scale datasets stored in GCS.
Question 6: In Azure, which service is used to ingest, process, and analyze streaming data in real time?
- Azure Data Factory
- Azure Stream Analytics (Correct answer)
- Azure Synapse Analytics
- Azure Data Lake Storage
Correct answer: Azure Stream Analytics
Azure Stream Analytics is a real-time analytics service designed to process high-throughput streaming data from sources like IoT devices and event hubs.
ADE ADE Cloud & Big Data Technologies 1
Which AWS service is commonly used as a managed Hadoop and Spark cluster for big data processing?