AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Crawl in the Storm's Trail
Prefect is a data orchestration tool. It lets you manage your compute environment more than air flow does. Airflow takes like a very firm ownership approach over, which means the scheduler becomes kind of the bottleneck for anything that you want to do. In our world, we will let you configure things called task runners that will say, okay, that now can manage the dependency. Our scheduler doesn't need to get involved. And then that's how you can start to scale up.