The Data Exchange with Ben Lorica cover image

Orchestrating Machine Learning Applications

The Data Exchange with Ben Lorica

00:00

Is Flight Integrating With Other Execution Engines?

Flight uses a similar architecture too, like spark. Spark also runs with this model of a driver and executors. There are people who know they need to use spark, but the team isn't an expertin writing spark. You can imagine that maybe one day you will write a work tough that queris data from lets a snowflake or libity run aray job to do some data processing on the data or osformations. Would just pick the one that works best for the step you want to do. We think of these tools as extensions ofe execution ingine that way.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app