Empire Inside AI's GPU Economy & Infrastructure Boom | Sam Hogan, Kuzco
21 snips
Jan 3, 2025 Sam Hogan, Founder and CEO of Kuzco, dives into the rapidly changing landscape of AI infrastructure. He highlights the shift from model training to inference, predicting it will dominate AI computing in just five years. Hogan elaborates on Kuzco's role as a marketplace for idle GPU power, utilizing crypto for transactions. The discussion progresses to insights on AI agents, their potential effects on human interaction, and the necessity of preserving genuine human connections amid the surge in AI-driven technology.
AI Snips
Chapters
Transcript
Episode notes
Inference Dominance
- AI compute is shifting from training to inference.
- Inference will dominate AI compute within five years due to increasingly useful models.
H100 Price Volatility
- H100 GPU prices spiked due to shortages, then dropped after NVIDIA's delivery.
- This illustrates market dynamics and the potential for future price fluctuations with newer GPUs.
Training vs. Inference
- Training creates AI models, while inference uses these models for real-world applications.
- Inference compute needs are rising as AI models become more practical and widely used.