Noam Brown is a research scientist at FAIR, Meta AI, co-creator of AI that achieved superhuman level performance in games of No-Limit Texas Hold’em and Diplomacy. Please support this podcast by checking out our sponsors: – True Classic Tees: https://trueclassictees.com/lex and use code LEX to get 25% off – Audible: https://audible.com/lex to get 30-day free trial – InsideTracker: https://insidetracker.com/lex to get 20% off – ExpressVPN: https://expressvpn.com/lexpod to get 3 months free EPISODE LINKS: Noam’s Twitter: https://twitter.com/polynoamial Noam’s LinkedIn: https://www.linkedin.com/in/noam-brown-8b785b62/ webDiplomacy: https://webdiplomacy.net/ Noam’s papers: Superhuman AI for multiplayer poker: https://par.nsf.gov/servlets/purl/10119653 Superhuman AI for heads-up no-limit poker: https://par.nsf.gov/servlets/purl/10077416 Human-level play in the game of Diplomacy: https://www.science.org/doi/10.1126/science.ade9097 PODCAST INFO: Podcast website: https://lexfridman.com/podcast Apple Podcasts: https://apple.co/2lwqZIr Spotify: https://spoti.fi/2nEwCF8 RSS: https://lexfridman.com/feed/podcast/ YouTube Full Episodes: https://youtube.com/lexfridman YouTube Clips: https://youtube.com/lexclips SUPPORT & CONNECT: – Check out the sponsors above, it’s the best way to support this podcast – Support on Patreon: https://www.patreon.com/lexfridman – Twitter: https://twitter.com/lexfridman – Instagram: https://www.instagram.com/lexfridman – LinkedIn: https://www.linkedin.com/in/lexfridman – Facebook: https://www.facebook.com/lexfridman – Medium: https://medium.com/@lexfridman OUTLINE: Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time. (00:00) – Introduction (05:37) – No Limit Texas Hold ’em (09:30) – Solving poker (22:40) – Poker vs Chess (29:18) – AI playing poker (1:02:46) – Heads-up vs Multi-way poker (1:13:37) – Greatest poker player of all time (1:17:10) – Diplomacy game (1:27:01) – AI negotiating with humans (2:09:26) – AI in geopolitics (2:14:11) – Human-like AI for games (2:20:12) – Ethics of AI (2:24:26) – AGI (2:28:25) – Advice to beginners

Noam Brown, a prominent researcher at OpenAI known for his deep reinforcement learning work, joins Ilge Akkaya and Hunter Lightman from the o1 research team. They discuss the innovative combination of LLMs and reinforcement learning, revealing how o1 excels in math and reasoning. Insights include the use of chains of thought and backtracking to enhance problem-solving. The team shares milestones like the success at the International Olympiad in Informatics and reflects on scaling challenges that may unlock even greater AI reasoning capabilities.

Noam Brown joins host Pieter Abbeel to discuss solving poker and Diplomacy with AI. Subscribe to the Robot Brains Podcast today | Visit therobotbrains.ai and follow us on YouTube at TheRobotBrainsPodcast and Twitter @therobotbrains. Hosted on Acast. See acast.com/privacy for more information.

Noam Brown is a research scientist at FAIR. During his Ph.D. at CMU, he made the first AI to defeat top humans in No Limit Texas Hold 'Em poker. More recently, he was part of the team that built CICERO which achieved human-level performance in Diplomacy. In this episode, we extensively discuss ideas underlying both projects, the power of spending compute at inference time, and much more.

AGI can beat top players in chess, poker, and, now, Diplomacy. In November 2022, a bot named Cicero demonstrated mastery in this game, which requires natural language negotiation and cooperation with humans. In short, Cicero can lie, scheme, build trust, pass as human, and ally with humans. So what does that mean for the future of AGI?This week’s guest is research scientist Noam Brown. He co-created Cicero on the Meta Fundamental AI Research Team, and is considered one of the smartest engineers and researchers working in AI today.Co-hosts Sarah Guo and Elad Gil talk to Noam about why all research should be high risk, high reward, the timeline until we have AGI agents negotiating with humans, why scaling isn’t the only path to breakthroughs in AI, and if the Turing Test is still relevant.Show Links: More about Noam Brown Read the research article about Cicero (diplomacy) published in Science.  Read the research article about Liberatus  (heads-up poker) published in Science.  Read the research article about Pluribus (multiplayer poker) published in Science.  Watch the AlphaGo Documentary. Read “How Smart Are the Robots Getting?” by New York Times reporter Cade Metz  Sign up for new podcasts every week. Email feedback to show@no-priors.comFollow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @PolynoamialShow Notes: [01:43] - What sparked Noam’s interest in researching AI that could defeat games[6:00] - How the AlexaNET and AlphaGo changed the landscape of AI research[8:09] - Why Noam chose Diplomacy as the next game to work on after poker[9:51] - What Diplomacy is and why the game was so challenging for an AI bot[14:50] - Algorithmic breakthroughs and significance of AI bots that win in No-Limit Texas Hold'em poker[23:29] - The Nash Equilibrium and optimal play in poker[24:53] - How Cicero interacted with humans [27:58] - The relevance and usefulness of the Turing Test[31:05] - The data set used to train Cicero[31:54] - Bottlenecks to AI researchers and challenges with scaling[40:10] - The next frontier in researching games for AI[42:55] - Domains that humans will still dominate and applications for AI bots in the real world[48:13] - Reasoning challenges with AI