Apache Kafka Kafka Architecture & Internals 2

Question 1

What is the Kafka 'high-water mark' (HWM)?

Accepted Answer

The highest offset that has been replicated to all in-sync replicas and is safe to expose to consumers

Answer

The high-water mark is the offset up to which all ISR replicas have acknowledged data; consumers can only read up to this offset to ensure consistency.

Question 2

What does the Kafka log-end offset (LEO) represent?

Accepted Answer

The next offset to be written, i.e., the offset of the last record + 1 in a replica's log

Answer

The log-end offset is the offset of the next message to be appended; it represents the tip of a replica's local log and may exceed the high-water mark on followers.

Question 3

How does a follower replica know it is out of sync with the leader?

Accepted Answer

When its LEO lags behind the leader's LEO for more than replica.lag.time.max.ms

Answer

A replica is removed from the ISR when it hasn't caught up with the leader's log within replica.lag.time.max.ms, indicating it is behind.

Question 4

What is a 'preferred replica election' in Kafka?

Accepted Answer

A process that restores partition leadership to the originally assigned (preferred) broker after a failover

Answer

After a broker failure and recovery, preferred replica election moves leadership back to the originally assigned broker to achieve balanced load distribution.

Question 5

What is the function of the Kafka `__transaction_state` internal topic?

Accepted Answer

Stores the state of ongoing and completed transactions managed by transaction coordinators

Answer

__transaction_state is Kafka's internal topic for persisting transaction status so that transaction coordinators can recover after a failure.

Apache Kafka Practice Test

Apache Kafka Practice Test

Apache Kafka Kafka Architecture & Internals 2