Mixture of Experts AI on IBM z17, Meta's Llama 4 and Google Cloud Next 2025
10 snips
Apr 11, 2025 
Join IBM trailblazers Hillery Hunter, an IBM Fellow and CTO of IBM Infrastructure, Shobhit Varshney, Head of Data and AI for the Americas, and Kate Soule, Director of Technical Product Management at Granite, as they dive into the launch of IBM z17 with its cutting-edge AI capabilities. Explore the unveiling of Meta's Llama 4, the innovations at Google Cloud Next, and the evolving perceptions of AI from the Pew Research Center. They tackle everything from zero downtime in financial transactions to AI's role in entertainment and industry dynamics.
AI Snips
Chapters
Transcript
Episode notes
High-Stakes Computing
- Hilary Hunter discussed how mainframes handle high-stakes computing, like credit card fraud detection.
- Real-time AI scoring is crucial for instant fraud detection in stores, enhancing consumer value.
AI Inference Location
- Shobhit Varshney emphasizes the need for AI inference close to transactions, particularly in financial institutions.
- This approach addresses latency issues and security concerns, enabling faster fraud detection.
Efficient AI Processing
- Mainframes offer efficient AI processing with lower power consumption compared to cloud-based solutions.
- Hillary Hunter highlighted a 5x efficiency gain by doing AI in place, relevant for energy and cost savings.