Mixture of Experts

NVIDIA’s USD 100bn investment and Google's AP2

Sep 26, 2025
Join Gabe Goodhart, expert in open-source AI, Mihai Criveti, a distinguished engineer in agentic AI, and Sandi Besen, an AI research engineer focused on safety and deployment. They dive into NVIDIA’s jaw-dropping $100 billion investment in OpenAI, exploring its potential impact on the AI landscape. The trio discusses Google's new AP2 protocol and its implications for secure agent commerce. They also tackle the safety concerns highlighted in the book 'If Anyone Builds It, Everyone Dies,' questioning the future of AI development. Don't miss their insights on Apple's forthcoming translation feature in AirPods!
Ask episode
AI Snips
Chapters
Books
Transcript
Episode notes
INSIGHT

Purpose-Built Model+Agent Leap

  • Tongyi DeepResearch pairs a purpose-built 30B mixture-of-experts model with agent software for long-horizon information tasks.
  • Gabe says the novelty is the model-task pairing and state-management architecture, not raw token generation.
INSIGHT

Open Source Targets Different Markets

  • Open-source models are finding distinct markets like on-device, behind-firewall, and cost-constrained use cases.
  • Mihai argues these purpose-built smaller models won't directly compete with frontier hosted models for every application.
ADVICE

Monetize Open Source With Enterprise Tiers

  • If you run an open-source lab, lean into enterprise tiers and integration rather than immediately closing the codebase.
  • Gabe recommends offering enterprise addons (auth, data sovereignty) and consulting to monetize open source.
Get the Snipd Podcast app to discover more snips from this episode
Get the app