
Orchestration and Pipelines for Data Scientists
The Data Exchange with Ben Lorica
00:00
Orchist and Data Pipelines in a Distributed System
The idea is to bring soter engineering rigor into how we built pipe lines. We actually like this pattern of a testing on your life system in a way that doesn't affecte the run time of the piplane itself. So i think everybody learns from air flow that you need to consider data passing between pipe line steps as a first class concept, which is the case in orchest.
Transcript
Play full episode