2min chapter

Lex Fridman Podcast cover image

#144 – Michael Littman: Reinforcement Learning and the Future of AI

Lex Fridman Podcast

CHAPTER

TD Temporal Difference Is Just Algorithms for Retorting Learning

TD temporal difference is about making predictions over time. You can try to use it for making decisions, right? Because if you can predict how good a future action and action outcomes will be in the future, you can choose one that has better. And so people don't know TD temporal difference. These are all just algorithms for reinforcement learning. Right. Q was off policy, which meant that you could actually be learning about the environment and what the value of different actions would be while figuring out how to behave optimally. So that was a revelation.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode