At the Edge Preparing for tomorrow’s agentic workforce
36 snips
Jun 12, 2025 Rodrigo Liang, Cofounder and CEO of SambaNova Systems, delves into the revolutionary concept of agentic AI and the pressing need for businesses to adapt their infrastructure. He emphasizes the staggering $5 trillion required for data centers to handle AI workloads, alongside the necessity of hybrid AI models. With a focus on enterprise integration, Rodrigo highlights how balancing large and specialized AI models can transform industries, enhance efficiency, and improve customer engagement—all while ensuring a secure and adaptable future.
AI Snips
Chapters
Transcript
Episode notes
AI-First Infrastructure Necessity
- The shift towards an AI-first world demands new, efficient computing infrastructure to handle increased scale and transformation.
- SambaNova was founded to create technology optimized for this emerging AI-centric era, moving beyond legacy computing limits.
Scaling AI Faces Physical Limits
- AI infrastructure expansion faces physical limits like power, cooling, and data center location challenges.
- More efficient core technology is essential; building more power plants alone is insufficient for scale.
Adopt Hybrid AI Infrastructure
- Use hybrid AI infrastructure combining cloud and on-prem solutions to optimize costs and performance.
- Leverage efficient APIs to access top open source models without massive custom investment.