DP-203 Azure Data Engineer Associate Data Integration and Pipelines Flashcards

Which ADF feature enables incremental data loading by tracking the last loaded watermark value?

Answer: Delta Copy with watermark

Delta Copy with a watermark pattern uses a high-watermark table to track the last successfully copied value and only copies new or changed records on subsequent runs.

When should you use Azure Data Factory's 'ForEach' activity?

Answer: To iterate over a collection of items and execute child activities for each

The ForEach activity iterates over a collection (array) and executes a set of inner activities for each item, supporting both sequential and parallel execution.

Which ADF activity allows you to execute a stored procedure on an Azure SQL Database or Azure Synapse Analytics?

Answer: Stored Procedure activity

The Stored Procedure activity in ADF directly invokes a stored procedure on Azure SQL Database, Azure Synapse, or SQL Server via a Linked Service.

In Azure Data Factory Mapping Data Flows, which transformation reduces the number of rows by computing summary statistics per group?

Answer: Aggregate

The Aggregate transformation groups rows by one or more columns and computes summary functions like SUM, COUNT, or AVG for each group.

What is the purpose of ADF's 'Validate' feature before publishing a pipeline?

Answer: To check for configuration errors in pipelines, datasets, and linked services

The Validate feature checks all pipeline artifacts for configuration errors, missing parameters, or invalid references before you publish changes to the ADF service.

Which Azure service can Azure Data Factory use as a source to trigger pipelines based on blob creation events?

Answer: Azure Event Grid

ADF's Storage Event Trigger integrates with Azure Event Grid to fire pipeline runs when blobs are created or deleted in an Azure Blob Storage or Data Lake Storage account.