The Data Exchange with Ben Lorica cover image

Orchestration and Pipelines for Data Scientists

The Data Exchange with Ben Lorica

00:00

Orchist and Data Pipelines in a Distributed System

The idea is to bring soter engineering rigor into how we built pipe lines. We actually like this pattern of a testing on your life system in a way that doesn't affecte the run time of the piplane itself. So i think everybody learns from air flow that you need to consider data passing between pipe line steps as a first class concept, which is the case in orchest.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app