Lex Fridman Podcast

#144 – Michael Littman: Reinforcement Learning and the Future of AI

Dec 13, 2020

In a captivating conversation, Michael Littman, a computer scientist from Brown University, shares his insights into reinforcement learning and its transformative potential in AI. He delves into the interplay between sci-fi and robotics, touching on humorous robot-human interactions. Michael also discusses the challenges of AI's existential risks, the creative process behind parody songwriting, and the evolution of AI through self-play. His reflections blend technical depth with light-hearted anecdotes, creating a thought-provoking dialogue about the future of technology.

02:01:55

Creator website

Episode guests

Michael Littman

Highlights

AI Chapters

Episode notes

Performance Ceilings Chess & Human AI Pairs?

02:44

Is ML a subfield of Comp Hardware

01:24

The Importance of Social Communication in Driving as a Theory of Mind

01:17

Intro

2min

Supporting the Show & Security Insights

6min

Blending Sci-Fi and Real Life: Robots, Music, and Improv

11min

The Freedom of Podcasting: Nuanced Conversations and Creative Insights

2min

The Creative Challenges of Parody Songwriting

2min

Navigating AI's Existential Impacts

19min

Journey Through AI and Reinforcement Learning

20min

Quirks of Technology and the Evolution of Musical Taste

2min

Self-Play and AI Evolution

9min

10.

Reinforcement Learning Evolution: From AlphaGo to AlphaZero

21min

11.

Navigating Moore's Law and Self-Driving Challenges

17min

12.

Empowering Through Programming

6min

13.

Exploring the Meaning of Life Through Balance and Reinforcement Learning

4min

Michael Littman is a computer scientist at Brown University. Please support this podcast by checking out our sponsors:
– SimpliSafe: https://simplisafe.com/lex and use code LEX to get a free security camera
– ExpressVPN: https://expressvpn.com/lexpod and use code LexPod to get 3 months free
– MasterClass: https://masterclass.com/lex to get 2 for price of 1
– BetterHelp: https://betterhelp.com/lex to get 10% off

EPISODE LINKS:
Michael’s Twitter: https://twitter.com/mlittmancs
Michael’s Website: https://www.littmania.com/
Michael’s YouTube: https://www.youtube.com/user/mlittman

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/LexFridmanPage
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(07:43) – Robot and Frank
(10:02) – Music
(13:13) – Starring in a TurboTax commercial
(23:26) – Existential risks of AI
(41:48) – Reinforcement learning
(1:07:36) – AlphaGo and David Silver
(1:17:15) – Will neural networks achieve AGI?
(1:29:42) – Bitter Lesson
(1:42:32) – Does driving require a theory of mind?
(1:51:58) – Book Recommendations
(1:57:20) – Meaning of life

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.