No Priors: Artificial Intelligence | Technology | Startups

The bot Cicero can collaborate, scheme and build trust with humans. What does this mean for the next frontier of AI? With Noam Brown, Research Scientist at Meta

Feb 2, 2023

Noam Brown, a research scientist at Meta and co-creator of Cicero, delves into the groundbreaking capabilities of AI in strategic games like Diplomacy. He discusses how Cicero can negotiate, build trust, and even deceive, raising questions about the future of artificial general intelligence. The conversation touches on the evolving significance of the Turing Test and the necessity of high-risk innovation in AI research. Noam also shares insights on human-AI collaboration and the implications of developing agents that can seamlessly integrate into social scenarios.

58:40

Creator website

Episode guests

Noam Brown

AI Chapters

Episode notes

Intro

2min

AI and Game Theory: A Journey of Discovery

11min

Exploring AI's Collaborative Potential in Games and Real-Life Scenarios

2min

AI vs. Poker: Revolutionizing Strategy

10min

Unexpected Success in AI Diplomacy: A Bot's Social Integration

3min

Evolving Perspectives on the Turing Test and Reasoning in AI

3min

Navigating AI Training Challenges

27min

AGI can beat top players in chess, poker, and, now, Diplomacy. In November 2022, a bot named Cicero demonstrated mastery in this game, which requires natural language negotiation and cooperation with humans. In short, Cicero can lie, scheme, build trust, pass as human, and ally with humans. So what does that mean for the future of AGI?

This week’s guest is research scientist Noam Brown. He co-created Cicero on the Meta Fundamental AI Research Team, and is considered one of the smartest engineers and researchers working in AI today.

Co-hosts Sarah Guo and Elad Gil talk to Noam about why all research should be high risk, high reward, the timeline until we have AGI agents negotiating with humans, why scaling isn’t the only path to breakthroughs in AI, and if the Turing Test is still relevant.

Show Links:

More about Noam Brown
Read the research article about Cicero (diplomacy) published in Science.
Read the research article about Liberatus (heads-up poker) published in Science.
Read the research article about Pluribus (multiplayer poker) published in Science.
Watch the AlphaGo Documentary.
Read “How Smart Are the Robots Getting?” by New York Times reporter Cade Metz

Show Notes:

[01:43] - What sparked Noam’s interest in researching AI that could defeat games

[6:00] - How the AlexaNET and AlphaGo changed the landscape of AI research

[8:09] - Why Noam chose Diplomacy as the next game to work on after poker

[9:51] - What Diplomacy is and why the game was so challenging for an AI bot

[14:50] - Algorithmic breakthroughs and significance of AI bots that win in No-Limit Texas Hold'em poker

[23:29] - The Nash Equilibrium and optimal play in poker

[24:53] - How Cicero interacted with humans

[27:58] - The relevance and usefulness of the Turing Test

[31:05] - The data set used to train Cicero

[31:54] - Bottlenecks to AI researchers and challenges with scaling

[40:10] - The next frontier in researching games for AI

[42:55] - Domains that humans will still dominate and applications for AI bots in the real world

[48:13] - Reasoning challenges with AI

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.