AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Empire
Inside AI's GPU Economy & Infrastructure Boom | Sam Hogan, Kuzco
Jan 3, 2025
Sam Hogan, Founder and CEO of Kuzco, dives into the rapidly changing landscape of AI infrastructure. He highlights the shift from model training to inference, predicting it will dominate AI computing in just five years. Hogan elaborates on Kuzco's role as a marketplace for idle GPU power, utilizing crypto for transactions. The discussion progresses to insights on AI agents, their potential effects on human interaction, and the necessity of preserving genuine human connections amid the surge in AI-driven technology.
01:06:26
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- The podcast highlights a significant shift towards AI inference computing, which is predicted to dominate 99% of AI compute within five years.
- Kuzco is revolutionizing the GPU market by creating a global marketplace for idle compute resources, making AI development more accessible and cost-effective.
Deep dives
Shift from Training to Inference
The podcast discusses a notable shift in the AI landscape, where historically, up to 95% of AI compute was dedicated to training models, and only 5% was used for inference. This trend is changing as models have become increasingly useful, leading to a balance where approximately half of the compute resources are now allocated to both training and inference. In the next few years, it is anticipated that this balance will tip in favor of inference, potentially reaching 99%, as the need for real-world applications and real-time interactions grows. This evolution indicates a transition to a new phase in AI development, where efficiently utilizing models in practical applications becomes more of a priority than just developing them.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode