Tech Disruptors
Google Cloud CTO on LLM Demand Surge, Use Cases
May 1, 2025
Will Grannis, Chief Technology Officer of Google Cloud, shares insights on the explosive demand for large language models like Gemini, boasting a 40x growth in usage. He highlights Google's Ironwood TPU, designed to enhance efficiency and performance significantly. The conversation dives into versatile use cases for AI across industries, emphasizing seamless integration and customer customization. Grannis also touches on the importance of authoritative data in AI applications and tackles future trends and market metrics in the ever-evolving tech landscape.
37:48
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Google Cloud has experienced a 40-fold growth in Gemini model usage on Vertex AI, reflecting soaring demand for AI solutions across various industries.
- The integration of advanced TPU technology enhances AI performance and energy efficiency, addressing diverse customer needs while promoting sustainable resource utilization.
Deep dives
Growth of AI and Customer Engagement
The podcast highlights a significant growth in AI adoption, particularly through Google Cloud's AI platform, Vertex, which has seen a 40-fold increase in usage of its Gemini model since the previous year. This popularity is also reflected in the development of numerous AI agents by customers of Google Cloud, aimed at meeting various business needs. The recent Google Cloud event showcased hundreds of these innovations, marking a notable shift in the pace and direction of technology adoption. The prevailing focus on AI and agent-based technologies indicates a trend where businesses increasingly leverage AI to enhance operational efficiency and customer engagement.
