TBPN Live Meta AI Deep Dive, Jeff Huber, Sheel Mohnot, Leif Abraham, Samuel Hammond, Víctor Perez, Jai Malik, Pratap Ranade
84 snips
Apr 8, 2025 
Join Jeff Huber, co-founder of Chroma, and Jai Malik, CEO of AMCA, as they dive into Meta's groundbreaking Llama 4 and its implications for open-source AI. Samuel Hammond shares vital insights on tech policy, while Sheel Mohnot discusses fintech market dynamics. Leif Abraham analyzes investor behavior amid turbulence, and Víctor Perez reveals how AI is revolutionizing creativity. The conversation flows through navigating economic challenges, the role of automation in manufacturing, and the interplay of innovation in finance and technology.
AI Snips
Chapters
Transcript
Episode notes
Llama 4 Evaluation
- Evaluate Llama 4 by what it enables compared to closed models.
- Open source allows fine-tuning and broader access, unlike DeepSeek.
Meta's LLM Journey
- Meta's Galactica, an academic LLM, was withdrawn after three days.
- Llama 1's weights were released to researchers, then leaked, sparking innovation.
AI's Memory Hierarchy
- AI isn't a god but a new computing form with a memory hierarchy.
- This hierarchy includes transformer heads, context windows, retrieval, and tool use, each with trade-offs.