"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

In this discussion, Tan Zhi Xuan, an MIT PhD student specializing in AI alignment, critiques traditional preference-based methods. They propose role-based AI systems shaped by social consensus, emphasizing the necessity of aligning AI with societal norms instead of mere preferences. The conversation touches on how AI can learn ethical standards through Bayesian reasoning and the exploration of self-other overlap to enhance cooperation. Xuan's innovative insights pave the way for a safer, more socially aware approach to AI development.

Robert Wright, publisher of the Nonzero Newsletter, dives into the intersection of AI development and international relations. They explore the militarization of AI and the burgeoning U.S.-China tensions, coining the concept of the 'chip war.' The discussion highlights the risks of an AI arms race and the pressing need for cooperative frameworks to avoid catastrophic conflict. They also consider the importance of trust and communication in U.S.-China relations and reflect on the timeline for significant AI advancements by 2027.

John Milinovich, the GenAI Product Lead at Canva, discusses how AI is revolutionizing design. He shares insights on balancing automation with user creativity, emphasizing Canva's AI tools like DreamLab that enhance design possibilities. The conversation covers the intuitive nature of future design interfaces, user control in AI interactions, and the role of innovative tools in streamlining workflows. Milinovich also highlights the significance of understanding customer needs in the evolving AI landscape.

Nathan Lambert, a machine learning researcher at the Allen Institute for AI and author of the Interconnex newsletter, dives into cutting-edge post-training techniques for large language models. He discusses the Tulu project, which enhances model performance through innovative methods like supervised fine-tuning and reinforcement learning. Lambert sheds light on the significance of human feedback, the challenges of data contamination, and the collaborative nature of AI research. His insights will resonate with anyone interested in the future of AI and model optimization.

Zvi Mowshowitz, an insightful thinker on AI safety and politics, shares his perspective on the rapid advancements in artificial intelligence. He discusses Ilya's new superintelligence startup and OpenAI's O1 model, evaluating their implications. The dialogue touches on the challenges of AI integration in businesses and its political ramifications, including the impact of deep fake technology on elections. Zvi also navigates the complexities of AI regulations and ethical dilemmas, offering a candid analysis of the industry’s future.

Daniel Kokotajlo, a former OpenAI policy researcher, shares his journey advocating for AGI safety, while Dean W. Ball offers insights on AI governance. They discuss the essential need for transparency and effective whistleblower protections in AI labs. Kokotajlo emphasizes the importance of personal sacrifice for ethical integrity, while Ball highlights how collaboration across political lines can influence AI development. Together, they explore the challenges and future of responsible AI policies, underscoring the necessity for independent oversight.

Joshua Steinman, former Senior Director for Cyber Policy on Trump’s National Security Council, discusses the interplay between AI advancements and politics. He shares insights on how a potential Trump presidency could shape U.S.-China relations and the tech landscape. Steinman emphasizes the risks of an AI arms race, the need for stable leadership, and the importance of expert consensus in navigating complex diplomatic waters. The conversation highlights political perceptions and the role of media narratives in shaping public opinion, offering a rich perspective on the stakes in the upcoming election.

Samuel Hammond, a senior economist at the Foundation for American Innovation and an expert on AI policy, offers intriguing insights into the intersection of politics and technology. He discusses the potential of a Trump presidency to reshape AI development, emphasizing the need for a collaborative approach amidst U.S.-China tensions. Hammond critiques current leadership for failing to prioritize innovation. The conversation delves into the ideological divides affecting AI policy and the necessity for a revitalized social contract in the AI era.

Logan Kilpatrick and Shrestha Basu Mallick, product managers at Google for the Gemini API and AI Studio, dive deep into the innovative features of Gemini. They discuss the new real-time search grounding capability, enhancing AI's responsiveness with live web information. The conversation highlights Gemini's competitive edge in the AI arena and successful business applications. They also touch on the significance of multimodal applications and the evolving landscape of AI technologies, providing valuable insights for developers.

In this episode of The Cognitive Revolution, Nathan dives deep into the world of state space models with returning co-host Jason Meaux and special guest Quentin Anthony, Head of Model Training at Zyphra. Explore the cutting-edge Zamba 2-7b model, which combines selective state space and attention mechanisms. Uncover practical insights on model training, architectural choices, and the challenges of scaling AI. From learning schedules to hybrid architectures, loss metrics to context length extension, this technical discussion covers it all. Don't miss this in-depth conversation on the future of personalized, on-device AI.Check out more about Zyphra and Jason Meaux here:Zyphra's website: https://www.zyphra.comZamba2-7B Blog: https://www.zyphra.com/post/zamba2-7bZamba2 GitHub: https://github.com/Zyphra/Zamba2Tree attention: https://www.zyphra.com/post/tree-attention-topology-aware-decoding-for-long-context-attention-on-gpu-clustersJason's Meaux Twitter: https://x.com/KamaraiCodeJason's Meaux website: https://www.statespace.infoBe notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccessSPONSORS:Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitiveNotion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolutionLMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcrCHAPTERS:(00:00:00) Teaser(00:00:42) About the Show(00:01:05) About the Episode(00:03:09) Introducing Zyphra(00:07:28) Personalization in AI(00:12:48) State Space Models & Efficiency (Part 1)(00:19:22) Sponsors: Weights & Biases RAG++ | Shopify(00:21:26) State Space Models & Efficiency (Part 2)(00:22:23) Dense Attention to Shared Attention(00:29:41) Zyphra's Early Bet on Mamba (Part 1)(00:33:18) Sponsors: Notion | LMNT(00:36:00) Zyphra's Early Bet on Mamba (Part 2)(00:37:22) Loss vs. Model Quality(00:44:53) Emergence & Grokking(00:50:06) Loss Landscapes & Convergence(00:56:55) Sophia, Distillation & Secrets(01:09:00) Competing with Big Tech(01:23:50) The Future of Model Training(01:30:02) Deep Dive into Zamba 1(01:34:24) Zamba 2 and Mamba 2(01:38:56) Context Extension & Memory(01:44:04) Sequence Parallelism(01:45:44) Zamba 2 Architecture(01:53:57) Mamba Attention Hybrids(02:00:00) Lock-in Effects(02:05:32) Mamba Hybrids in Robotics(02:07:07) Ease of Use & Compatibility(02:12:10) Tree Attention vs. Ring Attention(02:22:02) Zyphra's Vision & Goals(02:23:57) OutroSOCIAL LINKS:Website: https://www.cognitiverevolution.aiTwitter (Podcast): https://x.com/cogrev_podcastTwitter (Nathan): https://x.com/labenzLinkedIn: https://www.linkedin.com/in/nathanlabenz/