AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Retention Time in Kafka and Challenges of Backlog
This chapter discusses the concept of retention time in Kafka and the challenges of reading through a backlog of messages. It highlights the importance of ensuring that the system reading from Kafka can read faster than the rate at which events are entering Kafka to prevent message loss. Potential solutions and technologies, such as conflict-free replicated data types (C-L-D-T), are also mentioned.