Get the app
Patrick Ames
Principal engineer at Amazon Web Services, known for his expertise in managing exabyte-scale data and transitioning from Apache Spark to Ray.
Best podcasts with Patrick Ames
Ranked by the Snipd community
8 snips
Nov 21, 2024
• 25min
Is Apache Spark Too Costly? An Amazon Engineer Tells His Story
chevron_right
In this insightful discussion, Patrick Ames, a Principal Engineer at Amazon Web Services specializing in exabyte-scale data, shares his journey from Apache Spark to Ray. He reveals the challenges Spark posed as data volumes increased, leading to long processing times and high costs. Ames emphasizes the efficiency and cost advantages of Ray, a framework designed for scalable AI applications. He also touches on the significance of automation in daily life and the importance of community contributions to open-source innovations.
The AI-powered Podcast Player
Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
Get the app