Apache Kafka Kafka Connect

Question 1

What is Kafka Connect?

Accepted Answer

A framework for reliably streaming data between Kafka and external systems using connectors

Answer

Kafka Connect is a scalable, fault-tolerant framework that simplifies integrating Kafka with databases, storage systems, and other data sources/sinks.

Question 2

What is the difference between a 'source connector' and a 'sink connector' in Kafka Connect?

Accepted Answer

Source connectors ingest data into Kafka; sink connectors export data from Kafka to external systems

Answer

Source connectors pull data from external systems (like databases) into Kafka topics, while sink connectors push data from Kafka topics to external systems.

Question 3

What mode allows Kafka Connect to run as part of a distributed cluster for fault tolerance?

Accepted Answer

Distributed mode

Answer

In distributed mode, multiple Connect workers form a group, share connector tasks, and automatically rebalance when a worker joins or leaves.

Question 4

How do you deploy a connector in Kafka Connect distributed mode?

Accepted Answer

By posting a JSON configuration to the Connect REST API

Answer

You deploy connectors in distributed mode by sending a POST request with connector configuration JSON to the Connect workers' REST API endpoint.

Question 5

What is a 'task' in Kafka Connect?

Accepted Answer

The unit of work that implements the actual data copying, with multiple tasks enabling parallelism

Answer

A task is an implementation of the connector's copy logic; a connector can split work into multiple tasks running in parallel across Connect workers.

Apache Kafka Practice Test

Apache Kafka Practice Test

Apache Kafka Kafka Connect