Environment Variables

Real Efficiency at Scale with Sean Varley

Jul 24, 2025
In this discussion, Sean Varley, Chief Evangelist at Ampere Computing, dives into the urgent need for energy efficiency in AI. He highlights how power caps and utilization are more critical than sheer compute power. Varley showcases Ampere’s innovative chip designs that enable sustainable cloud-native computing, and discusses partnerships, like the one with Rakuten, which have resulted in significant energy savings. The conversation also touches on the importance of machine utilization and innovative cooling solutions for greener data centers.
Ask episode
AI Snips
Chapters
Books
Transcript
Episode notes
INSIGHT

Ampere's Power Efficiency Opportunity

  • Ampere saw a major opportunity to achieve equal or better cloud performance at half the power usage about seven years ago.
  • The evolution of cloud computing demanded a fresh approach focusing on sustainability and energy efficiency.
ADVICE

Use Containerized Specialist Code

  • Use containers and cloud-native microservices to leverage specialist optimized code.
  • Trust containerized functions built by experts for efficient hardware utilization.
ADVICE

Maximize Processor Utilization

  • Run processors at 80-90% utilization instead of 50% to maximize power efficiency.
  • Higher utilization saves 30-50% power and avoids underused machine waste.
Get the Snipd Podcast app to discover more snips from this episode
Get the app