Data Engineering Introduction To Data Engineering 2

Question 1

What is the primary role of a data engineer in an organization?

Accepted Answer

Building and maintaining data pipelines and infrastructure

Answer

Data engineers build and maintain the pipelines and infrastructure that make data available for analysis.

Question 2

Which process describes Extract, Transform, Load (ETL)?

Accepted Answer

Pulling data from sources, reshaping it, then storing it in a target system

Answer

ETL extracts data from sources, transforms it into a usable shape, and loads it into a destination.

Question 3

What distinguishes a data warehouse from a data lake?

Accepted Answer

A warehouse stores structured, schema-defined data while a lake stores raw data of any format

Answer

Warehouses hold structured, schema-on-write data, while lakes hold raw data in many formats with schema-on-read.

Question 4

Which of the following is a common batch processing framework?

Accepted Answer

Apache Spark

Answer

Apache Spark is a widely used distributed engine for batch (and stream) data processing.

Question 5

What does 'data normalization' aim to reduce in a relational database?

Accepted Answer

Data redundancy and update anomalies

Answer

Normalization organizes tables to minimize redundancy and avoid anomalies during updates.

Data Engineering Practice Test