The Sequel Show cover image

Data Orchestration and Config as Code with Nick Shrock, Creator of Dagster

The Sequel Show

00:00

When Should You Decompose a Python Script?

When do you want to decompose a Python script, say, that's doing data calculations into a sequence of steps or a graph of steps? I think it expresses itself differently at different scales. So in single player mode, the parallelism is a clear win and the need to be able to replay from step two over and over again is something where you get a lot of productivity gains. Once you feel the local productivity hit, when of being able to kind of, like, start from step twoover and over again, that's a good indication that it's time to structure your programming in this fashion.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app