Happy Path Programming cover image

#55 Apache Kafka - Like Functional Programming but for Data (With Anna McDonald)

Happy Path Programming

CHAPTER

The Importance of Reproducible Scientific Data in Kafka

Kafka streams use stream time, just like flink has watermarks and they have their own thing too. But the deterministic processing of records for something like what you're talking about is paramount. There one caveat to that may be that to deal with vast amounts of data in Kafka, you probably are going to have to partition it. And if I don't know if there's a use case where you wouldn't have something to partition on, but it definitely don't care about order.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner