Mixture of Experts Google I/O, NLWeb, llm-d and is Stack Overflow dead?
11 snips
May 23, 2025 Join Marina Danilevsky, a senior research scientist in AI, Abraham Daniels, a technical product manager, and Gabe Goodhart, chief architect in open innovation as they unpack the latest from Google I/O 2025. They delve into whether Google’s AI Ultra subscription is worth it and discuss the implications of RedHat's new llm-d for Kubernetes. They also tackle Microsoft’s NLWeb and the transforming nature of search. Finally, the trio examines Stack Overflow's decline, pondering if AI is pushing it towards obsolescence.
AI Snips
Chapters
Transcript
Episode notes
Google's AI Ultra Bundling Strategy
- Google's $250 AI Ultra plan bundles cutting-edge features like video and audio generation, creating a data-rich ecosystem.
- This bundling strategy helps Google collect user data to improve services despite high subscription costs.
The AI Bundling Economy
- AI subscription services function like cable bundles, competing to offer the best mix of features.
- Open source may disrupt this by offering a la carte AI tools, akin to early streaming services.
Search: Baseline for AI Agents
- Search is becoming a baseline capability for AI agents rather than a novel feature.
- Integrating search effectively is essential for any competitive agent framework.