Data Processing Cycle 2

Question 1

In an ETL pipeline cycle, what does the 'T' phase primarily involve?

Accepted Answer

Transforming raw data into a structured format

Answer

The Transform phase converts raw extracted data into the required format, structure, or quality level for the target system.

Question 2

Which term describes a data processing cycle where new data is accumulated and processed at scheduled intervals rather than continuously?

Accepted Answer

Batch processing

Answer

Batch processing collects data over a period and processes it all at once at scheduled times, such as nightly or weekly runs.

Question 3

A processing cycle that runs every few seconds or minutes, balancing latency and throughput, is best described as:

Accepted Answer

Micro-batch processing

Answer

Micro-batch processing runs at very short intervals (seconds to minutes), bridging the gap between batch and real-time streaming.

Question 4

In the data lifecycle cycle, 'data archival' typically occurs at which stage?

Accepted Answer

After data is no longer frequently accessed

Answer

Archival moves data to cheaper, slower storage once it is no longer actively needed but must be retained for compliance or reference.

Question 5

What is a 'hot path' in a Lambda architecture data processing cycle?

Accepted Answer

The speed layer that processes real-time streaming data for low-latency results

Answer

The hot path (speed layer) handles real-time data to provide low-latency query results while the batch layer catches up.

Data Processing Practice Test