Data Processing Data Processing Tools and Technologies 3

Question 1

What is a data pipeline?

Accepted Answer

A series of automated steps that move and transform data from source to destination

Answer

A physical cable connecting servers

Answer

A database schema design pattern

Answer

A UI component for visualizing charts

Question 2

What does idempotency mean in data processing?

Accepted Answer

Running the same processing job multiple times produces the same result without side effects

Answer

Data is encrypted with a unique key each run

Answer

Each job run generates a different random output

Answer

Data is automatically deleted after processing

Question 3

What is a DAG in pipeline orchestration tools like Apache Airflow?

Accepted Answer

Directed Acyclic Graph — a structure defining task dependencies with no cycles

Answer

Dynamic Aggregation Generator

Answer

Data Archive Gateway

Answer

Distributed Asynchronous Grid

Question 4

What is data serialization?

Accepted Answer

Converting data structures into a format that can be stored or transmitted and later reconstructed

Answer

Deleting data in sequential order

Answer

Running queries one at a time

Answer

Encrypting data with a serial number

Question 5

What is the purpose of schema registry in streaming data architectures?

Accepted Answer

Centrally managing and enforcing data schemas for messages in a streaming system

Answer

Storing user login credentials

Answer

Archiving schema change logs to tape

Answer

Generating random test data

Question 6

What is data compression used for in processing pipelines?

Accepted Answer

Reducing the size of data to lower storage costs and speed up data transfer

Answer

Increasing query latency

Answer

Encrypting sensitive records

Answer

Splitting tables into partitions