Eye On A.I. #251 Sid Sheth: How d-Matrix is Disrupting AI Inference in 2025
24 snips
Apr 30, 2025 In a captivating discussion, Sid Sheth, CEO and Co-Founder of d-Matrix, dives into how his startup is transforming AI inference. He highlights the significance of inference over training for the future of AI and how d-Matrix’s Corsair PCIe accelerator outshines NVIDIA's offerings. Sid explains the role of in-memory compute technologies, the shift towards heterogeneous AI infrastructure, and the global landscape of inference chips. With insights from his extensive semiconductor background, he reveals his vision for creating a formidable competitor to industry giants.
AI Snips
Chapters
Transcript
Episode notes
Sid Sheth's Career Path
- Sid Sheth started his career as a chip designer at Intel, spending 10 years on cutting-edge processor and interconnect chips.
- He later transitioned to business roles, successfully building a $2.5B data center interconnect business acquired by Marvell in 2021.
Intercepting Market Transitions
- Semiconductor success requires intercepting market and technology transitions at the right time.
- D-Matrix targets the growing inference market, which demands efficiency-oriented architectures distinct from training.
Chip Prototyping at TSMC
- D-Matrix prototypes chips using TSMC's multi-project wafer (MPW) shuttle programs to test designs at smaller scale.
- This approach allows them to refine technology before full productization.