AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Orchist and Data Pipelines in a Distributed System
The idea is to bring soter engineering rigor into how we built pipe lines. We actually like this pattern of a testing on your life system in a way that doesn't affecte the run time of the piplane itself. So i think everybody learns from air flow that you need to consider data passing between pipe line steps as a first class concept, which is the case in orchest.