Bloomberg Talks AWS CEO Matt Garman Talks Amazon's Latest Innovations, AI Goals
6 snips
Dec 3, 2024 
AWS CEO Matt Garman, a leader in cloud technology and AI innovations, discusses Amazon’s latest advancements in AI and partnerships with companies like Anthropic. He highlights the revolutionary Tranium 2 chip, which outperforms GPUs for generative AI tasks. Garman emphasizes the importance of collaboration in the cloud computing landscape, while exploring the potential integration of OpenAI models into AWS's Bedrock platform. He also touches on the geopolitical impacts on technology and economic growth, reiterating AWS's commitment to global support.
AI Snips
Chapters
Transcript
Episode notes
Ultra Clusters for AI
- AWS is building ultra clusters with Anthropic, containing hundreds of thousands of Tranium 2 chips.
- These clusters aim to provide five times more compute power for AI model training.
Technical Challenges of AI Clusters
- Building large AI clusters presents technical difficulties in cooling, energy use, and performance.
- AWS addresses these by creating custom Tranium 2 chips and in-house networking for enhanced performance.
Tranium 2 vs. NVIDIA GPUs
- AWS offers Tranium 2 as a lower-cost alternative to NVIDIA GPUs for AI workloads.
- While NVIDIA remains a key partner, Tranium aims to provide 30-40% better cost performance.