#658: Mobileye steers engineering agility with Amazon EKS
Mar 18, 2024
auto_awesome
Learn how Mobileye shifted their massive Spark workloads to Amazon EKS for autonomous vehicle mapping, overcoming challenges and achieving impressive performance gains. Explore the advantages of scalability and easy component addition, as well as the cultural shifts required for the migration. Discover the process of implementing EKS in production and optimizing architecture performance and cost efficiency with AWS solutions.
Mobileye migrated massive Spark workloads to EKS for autonomous vehicle mapping, achieving impressive performance gains.
Transitioning to EKS enabled Mobileye to orchestrate high-performance workloads effectively despite initial challenges.
Deep dives
Mobileye's Journey into Kubernetes and EKS
Mobileye embarked on a journey into Kubernetes and specifically EKS to enhance their mapping process for autonomous vehicles. They previously faced limitations with their system that didn't offer the dynamic configuration of Kubernetes, hindering their ability to scale and integrate components efficiently. By transitioning to EKS, Mobileye aimed to build a massive scale platform with robust capabilities.
Transitioning to Kubernetes Without Prior Experience
Mobileye's team had no prior experience with Kubernetes before transitioning to EKS. Despite warnings of its complexity, they learned that Kubernetes was ideal for managing intricate systems at massive scales. Although challenging initially, the team adapted to Kubernetes' unique terminology and flexibility, enabling them to orchestrate high-performance workloads effectively.
Advantages and Performance Improvements with EKS
Utilizing EKS streamlined Mobileye's system setup, removing the need to manually configure Kubernetes clusters and providing essential components like DNS and storage through EKS blueprints. They observed significant improvements in performance, such as running diverse configurations simultaneously, enabling dynamic adjustments for varying workloads. EKS also simplified the integration of third-party tools and enhanced operational efficiency for tasks like environment variable changes.
Cost-Effectiveness and Advice for Newcomers
For cost-effectiveness, Mobileye leveraged AWS Carpenter and EC2 Spot instances within EKS, optimizing infrastructure utilization and reducing expenses. Their advice for newcomers includes leveraging AWS documentation, exploring the data on EKS project for valuable resources, and collaborating closely with AWS account teams for tailored support. They emphasize overcoming fears of Kubernetes terminology, utilizing open-source tools, and seeking assistance from AWS experts when scaling up operations.
In this episode, find out how Mobileye migrated their massive scale Spark workloads for autonomous vehicle mapping to Amazon Elastic Kubernetes Service (EKS), the challenges they overcame, the cultural shifts required, and the impressive performance gains they achieved by adopting Kubernetes.
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode