
Building a Reliable Kafka Data Processing Pipeline With Lily Mara
The InfoQ Podcast
00:00
How Asynchronous Workflows Have Changed How We Measure Performance
Most of the problems that our company faces are Postgres scaling problems. That's when you start having a key that says, I know where to send this data to Kafka and that's going to correspond to the shard in Postgres as well. And so that's part of the customer app ID. So that's in the request that's coming in. So you know from that HTTP request, here's the data I want to update. And here's who I am.
Transcript
Play full episode