Stream Data Lineage

There's a chicken and egg situation in there, isn't it? You might be migrating because you want a platform with better stream data lineage tools. But you don't have those in your old platform so you've got to just manually construct the stream lineage. My naive strategy would be migrate all the readers or the consumers first then migrate all the writers the producers. Once that's done, is that roughly right? What am I missing?Yeah, I think that that is roughly right. It kind of goes back to the offset translation bit and, you know, if certain consumers can process duplicates if they can miss messages. So a lot of it comes down to understanding the business requirements for

Play episode from 31:43

Transcript

Episode notes

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!

Get the app