Secrets of Data Analytics Leaders cover image

Jeff Magnusson: How To Create A Self-Service Data Platform For Data Scientists

Secrets of Data Analytics Leaders

00:00

Empowering Data Scientists Through Self-Service Platform

The chapter delves into the technology stack of a data platform deployed on AWS, highlighting Spark, Presto, and containerized ECS tasks. It emphasizes self-service for data scientists, challenges of managing shared resources, and solutions like visibility tools. Additionally, it explores the evolving roles of data engineers and data scientists within the platform, emphasizing autonomy in building pipelines and ensuring code quality and performance.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app