Apache Kafka
3 articles in the last 30 days.
-
Message Queues
A system design walkthrough of why message queues exist, using a photo upload example, and how they handle back pressure, dead letter queues, ordering and idempotency across SQS, Kafka and RabbitMQ.
-
How Flink's Kafka connector commits offsets to Kafka
Explains how Flink stores Kafka offsets in checkpoints and why read_committed transactions could leave reported consumer lag stuck at 1 (FLINK-33484).
-
How Flink's Kafka connector commits offsets to Kafka
Explains how Flink tracks source offsets in checkpointed state and why its committed Kafka offsets can stick at lag 1 on transactional topics, which the author fixed in FLINK-33484.