Why Reinforcement Learning Is Inefficient

Joelle Pineau is the Chief Scientist at Cohere, where she leads research on advancing large language models and practical AI systems. Before joining Cohere, she was VP of AI Research at Meta, where she founded and led Meta AI's Montreal lab. A professor at McGill University, Joelle is renowned for her pioneering work in reinforcement learning, robotics, and responsible AI development.

AGENDA:

00:00 Introduction to AI Scaling Laws

03:00 How Meta Shaped How I Think About AI Research

04:36 Challenges in Reinforcement Learning

10:00 Is It Possible to be Capital Efficient in AI

15:52 AI in Enterprise: Efficiency and Adoption

22:15 Security Concerns with AI Agents

28:34 Can Zuck Win By Buying the Galacticos of AI

32:15 The Rising Cost of Data

35:28 Synthetic Data and Model Degradation

37:22 Why AI Coding is Akin to Image Generation in 2015

48:46 If Joelle Was a VC Where Would She Invest?

52:17 Quickfire: Lessons from Zuck, Biggest Mindset Shift