Meta's AI Strategy and the Rise of Hybrid Models

We are celebrating MoE podcast’s one year anniversary! In episode 53 of Mixture of Experts, host Tim Hwang is joined by the O.G. panel of experts from our pilot—Chris Hay, Shobhit Varshney and Kush Varshney. This week, we cover some exciting announcements at LlamaCon. Then, we discuss some new Chinese AI models from Qwen3 to the rumored DeepSeek-R2. Next, J.P. Morgan’s CISO, Patrick Opet, released “An open letter to our third-party suppliers,” covering the need for AI security. Are we doomed? Finally, we look back at some of the topics we discussed in episode 1—the Rabbit AI device, GPT-2 chatbot, Apple Intelligence—after all that, who was the first person to say “agents” on the podcast?  Tune in to find out, on today’s one-year celebration of Mixture of Experts. 

00:00 -- Intro

00:38 -- LlamaCon

10:34 -- Qwen3 and DeepSeek-R2

23:23 -- J.P. Morgan’s open letter 

39:45 -- One year of MoE

The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.