The InfoQ Podcast cover image

Building a Reliable Kafka Data Processing Pipeline With Lily Mara

The InfoQ Podcast

00:00

How Asynchronous Workflows Have Changed How We Measure Performance

Most of the problems that our company faces are Postgres scaling problems. That's when you start having a key that says, I know where to send this data to Kafka and that's going to correspond to the shard in Postgres as well. And so that's part of the customer app ID. So that's in the request that's coming in. So you know from that HTTP request, here's the data I want to update. And here's who I am.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app