
Jeff Magnusson: How To Create A Self-Service Data Platform For Data Scientists
Secrets of Data Analytics Leaders
00:00
Empowering Data Scientists Through Self-Service Platform
The chapter delves into the technology stack of a data platform deployed on AWS, highlighting Spark, Presto, and containerized ECS tasks. It emphasizes self-service for data scientists, challenges of managing shared resources, and solutions like visibility tools. Additionally, it explores the evolving roles of data engineers and data scientists within the platform, emphasizing autonomy in building pipelines and ensuring code quality and performance.
Transcript
Play full episode