
Episode 40: DeepSeek facts vs hype, model distillation, and open source competition
Mixture of Experts
00:00
Exploring AI Dynamics: Compute Needs and Jevin's Paradox
This chapter explores current trends in artificial intelligence, emphasizing Jevin's Paradox and its influence on the future of computing. The discussion includes the impact of innovative training methods, new chip architectures, and the balance between computing power and model efficiency.
Transcript
Play full episode