#564: [INTRODUCING] Amazon Athena for Apache Spark
AWS Podcast
00:00
Apache Spark on Amazon Athena
We really wanted to bring the same ease of use and fully managed experience that Athena customers have been enjoying for Presto to Spark. Distreated applications like Apache Spark perform best when they can scale up and down rapidly. It's based on a combination of the same firecracker virtual machines used to power AWS Lambda, as well as a classic example of Amazon's invent and simplify leadership principle. We take advantage of the vastness of the IPv6 address space to deliver private networking between the Spark nodes without sacrificing start time.
Transcript
Play full episode
