The Complexity of Defining Reward Functions in Life and AI

Noam Brown is a research scientist at FAIR, Meta AI, co-creator of AI that achieved superhuman level performance in games of No-Limit Texas Hold’em and Diplomacy. Please support this podcast by checking out our sponsors:
– True Classic Tees: https://trueclassictees.com/lex and use code LEX to get 25% off
– Audible: https://audible.com/lex to get 30-day free trial
– InsideTracker: https://insidetracker.com/lex to get 20% off
– ExpressVPN: https://expressvpn.com/lexpod to get 3 months free

EPISODE LINKS:
Noam’s Twitter: https://twitter.com/polynoamial
Noam’s LinkedIn: https://www.linkedin.com/in/noam-brown-8b785b62/
webDiplomacy: https://webdiplomacy.net/
Noam’s papers:
Superhuman AI for multiplayer poker: https://par.nsf.gov/servlets/purl/10119653
Superhuman AI for heads-up no-limit poker: https://par.nsf.gov/servlets/purl/10077416
Human-level play in the game of Diplomacy: https://www.science.org/doi/10.1126/science.ade9097

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(05:37) – No Limit Texas Hold ’em
(09:30) – Solving poker
(22:40) – Poker vs Chess
(29:18) – AI playing poker
(1:02:46) – Heads-up vs Multi-way poker
(1:13:37) – Greatest poker player of all time
(1:17:10) – Diplomacy game
(1:27:01) – AI negotiating with humans
(2:09:26) – AI in geopolitics
(2:14:11) – Human-like AI for games
(2:20:12) – Ethics of AI
(2:24:26) – AGI
(2:28:25) – Advice to beginners