3min chapter

Secrets of Data Analytics Leaders cover image

Jeff Magnusson: How To Create A Self-Service Data Platform For Data Scientists

Secrets of Data Analytics Leaders

CHAPTER

Creating a Self-Service Batch Job Execution Service with Flotilla API

The chapter explores the open sourcing of Flotilla, an API designed for managing batch-oriented tasks in data science departments. Citrix's utilization of Spark and Docker on ECS for batch execution, performing data wrangling in Spark and model training in Docker containers is highlighted, showcasing how Flotilla abstracts over ECS to streamline job execution processes.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode