
Orchestrating Machine Learning Applications
The Data Exchange with Ben Lorica
00:00
Is Flight Integrating With Other Execution Engines?
Flight uses a similar architecture too, like spark. Spark also runs with this model of a driver and executors. There are people who know they need to use spark, but the team isn't an expertin writing spark. You can imagine that maybe one day you will write a work tough that queris data from lets a snowflake or libity run aray job to do some data processing on the data or osformations. Would just pick the one that works best for the step you want to do. We think of these tools as extensions ofe execution ingine that way.
Transcript
Play full episode