AWS Podcast cover image

#564: [INTRODUCING] Amazon Athena for Apache Spark

AWS Podcast

CHAPTER

Apache Spark on Amazon Athena

We really wanted to bring the same ease of use and fully managed experience that Athena customers have been enjoying for Presto to Spark. Distreated applications like Apache Spark perform best when they can scale up and down rapidly. It's based on a combination of the same firecracker virtual machines used to power AWS Lambda, as well as a classic example of Amazon's invent and simplify leadership principle. We take advantage of the vastness of the IPv6 address space to deliver private networking between the Spark nodes without sacrificing start time.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner