Data Processing Data Processing Tools and Technologies

Question 1

What is Apache Spark primarily used for?

Accepted Answer

Fast, distributed large-scale data processing in memory across a cluster

Answer

Web server hosting

Answer

Email routing and filtering

Answer

Compiling Java source code

Question 2

What is Apache Kafka primarily used for?

Accepted Answer

High-throughput distributed event streaming and message queuing

Answer

Running SQL queries on relational databases

Answer

Generating machine learning models

Answer

Building REST APIs

Question 3

What does a message broker do in a data pipeline?

Accepted Answer

Routes and queues messages between producers and consumers to decouple systems

Answer

Encrypts messages during transmission

Answer

Compresses messages for long-term storage

Answer

Generates automated email notifications

Question 4

What is dbt (data build tool) used for in data engineering?

Accepted Answer

Transforming data inside a warehouse using SQL-based models and version-controlled code

Answer

Running batch jobs on Hadoop

Answer

Monitoring server CPU usage

Answer

Generating synthetic training data

Question 5

What is Snowflake in the context of data processing?

Accepted Answer

A cloud-native data warehouse platform that separates compute and storage

Answer

A caching layer for Linux servers

Answer

A stream processing framework

Answer

A data encryption library

Question 6

What is Databricks primarily known for?

Accepted Answer

A unified data analytics platform built on Apache Spark for collaborative data engineering and ML

Answer

Network firewall management

Answer

A relational database engine

Answer

A CSS framework for web development