
159: Langchain with Elixir and Safe Ecto Migrations
Thinking Elixir Podcast
00:00
The Importance of Dry Run in Big Data Migrations
I love the idea of the dry run aspect, but having a UI on it too. I had some inspiration during my time at Stripe. They leveraged Kafka to emit events basically. You would query the data set that you're targeting here and then that query would have like an ID so they would kind of persist that little data set in a different database as a sort of temporary table or something. That's the kind of system. And even before joining Stripe, I was like, I need to build this thing. It's just very complicated with their insane infrastructure, but it's here. There's no chance that that can get pulled out. So I would like to build a
Transcript
Play full episode