AI and the Future of Work: Artificial Intelligence in the Workplace, Business, Ethics, HR, and IT for AI Enthusiasts, Leaders and Academics 366: Inside the Age of Inference: Sid Sheth, CEO and Co-Founder of d-Matrix, on Smaller Models, AI Chips, and the Future of Compute
Dec 8, 2025
In this discussion, Sid Sheth, CEO and co-founder of d-Matrix, shares insights from his extensive semiconductor experience. He emphasizes that AI inference represents a transformative opportunity, driving productivity unlike any previous tech shift. Sid explains how more efficient, smaller models are key to AI's scalability and why a talent shortage could impede progress. He also discusses the need for purpose-built AI chips and highlights D-Matrix's innovative approach to integrating into existing data centers.
AI Snips
Chapters
Books
Transcript
Episode notes
AI As A Greater Platform Shift
- AI is a platform shift that makes intelligence and productivity broadly available to everyone.
- Sid Sheth argues this will unleash massive productivity gains beyond previous tech shifts.
Reinvent Your Career With AI
- Reinvent yourself by learning and adopting AI tools to stay relevant.
- Embrace AI as augmentation rather than competition to unlock new career opportunities.
From Training To The Age Of Inference
- The last decade focused on training large models; 2025 marks a shift to deploying trained models.
- Smaller distilled models enable the "age of inference" because they're cheaper and easier to run at scale.
