Noam Brown, a research scientist at Meta AI, co-created systems that outsmart humans in poker and diplomacy. He discusses how AI achieved superhuman levels in these strategic games, highlighting the psychological dynamics of high-stakes poker. Brown explores the interplay between AI and human decision-making, emphasizing emotional engagement and trust in negotiations. He also delves into the future of AI in gaming, particularly its impact on non-playable characters and the ethical implications of replicating human-like decision processes.

Join Noam Brown, an OpenAI expert in deep reinforcement learning known for his poker-playing AI, and Hunter Lightman, a developer of O1, as they dive into the groundbreaking O1 model. They discuss the blend of LLMs and reinforcement learning, revealing how O1 excels at math and coding challenges. Discover insights on problem-solving methods, iterative reasoning, and the surprising journey from doubt to confidence in AI. With exciting applications like the International Olympiad in Informatics and beyond, the future of reasoning in AI seems bright!

Noam Brown joins host Pieter Abbeel to discuss solving poker and Diplomacy with AI. Subscribe to the Robot Brains Podcast today | Visit therobotbrains.ai and follow us on YouTube at TheRobotBrainsPodcast and Twitter @therobotbrains. Hosted on Acast. See acast.com/privacy for more information.

Noam Brown is a research scientist at FAIR. During his Ph.D. at CMU, he made the first AI to defeat top humans in No Limit Texas Hold 'Em poker. More recently, he was part of the team that built CICERO which achieved human-level performance in Diplomacy. In this episode, we extensively discuss ideas underlying both projects, the power of spending compute at inference time, and much more.

AGI can beat top players in chess, poker, and, now, Diplomacy. In November 2022, a bot named Cicero demonstrated mastery in this game, which requires natural language negotiation and cooperation with humans. In short, Cicero can lie, scheme, build trust, pass as human, and ally with humans. So what does that mean for the future of AGI?This week’s guest is research scientist Noam Brown. He co-created Cicero on the Meta Fundamental AI Research Team, and is considered one of the smartest engineers and researchers working in AI today.Co-hosts Sarah Guo and Elad Gil talk to Noam about why all research should be high risk, high reward, the timeline until we have AGI agents negotiating with humans, why scaling isn’t the only path to breakthroughs in AI, and if the Turing Test is still relevant.Show Links: More about Noam Brown Read the research article about Cicero (diplomacy) published in Science.  Read the research article about Liberatus  (heads-up poker) published in Science.  Read the research article about Pluribus (multiplayer poker) published in Science.  Watch the AlphaGo Documentary. Read “How Smart Are the Robots Getting?” by New York Times reporter Cade Metz  Sign up for new podcasts every week. Email feedback to show@no-priors.comFollow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @PolynoamialShow Notes: [01:43] - What sparked Noam’s interest in researching AI that could defeat games[6:00] - How the AlexaNET and AlphaGo changed the landscape of AI research[8:09] - Why Noam chose Diplomacy as the next game to work on after poker[9:51] - What Diplomacy is and why the game was so challenging for an AI bot[14:50] - Algorithmic breakthroughs and significance of AI bots that win in No-Limit Texas Hold'em poker[23:29] - The Nash Equilibrium and optimal play in poker[24:53] - How Cicero interacted with humans [27:58] - The relevance and usefulness of the Turing Test[31:05] - The data set used to train Cicero[31:54] - Bottlenecks to AI researchers and challenges with scaling[40:10] - The next frontier in researching games for AI[42:55] - Domains that humans will still dominate and applications for AI bots in the real world[48:13] - Reasoning challenges with AI