Data Processing Cycle 3

Question 1

In a data quality lifecycle, which cycle step validates that transformed data conforms to expected business rules before loading?

Accepted Answer

Pre-load validation / data quality checks

Answer

Pre-load validation applies business rule checks on transformed data to catch errors before they reach the target system.

Question 2

A circular dependency in a data pipeline cycle means:

Accepted Answer

Task A depends on Task B, and Task B depends on Task A, creating an infinite loop

Answer

A circular dependency creates a deadlock where neither task can start because each waits for the other to complete first.

Question 3

In data processing, 'idempotency' means a pipeline step can be run multiple times in the same cycle and:

Accepted Answer

Produce the same result without causing duplicate or incorrect data

Answer

An idempotent operation produces the same output regardless of how many times it is executed, preventing data corruption during retries.

Question 4

Which scheduling strategy triggers a new processing cycle only when the upstream data source signals that new data is available?

Accepted Answer

Event-driven scheduling

Answer

Event-driven scheduling starts a processing cycle in response to a trigger event, such as a file arrival or message queue notification.

Question 5

The 'medallion architecture' in data lakes uses three cycle stages. In order, these are:

Accepted Answer

Bronze → Silver → Gold

Answer

Bronze holds raw ingested data, Silver holds cleaned/conformed data, and Gold holds business-level aggregated data ready for analytics.

Data Processing Practice Test