4min chapter

The Robot Brains Podcast cover image

Sergey Levine explains the challenges of real world robotics

The Robot Brains Podcast

CHAPTER

Offline Reinforcement Learning

offline reinforcement learning is different from the more canonical, onland reinforcement learning. The challenge is that if we think about the active process, the one where it's like you train a dog,. If the a i agent has some idea about an action that might be good, but it doesn't know if it's good, what is it going to do? Wel is going o go and try that action, experience the outcome and adjust its understanding accordingly. In off line arl, how do you determine if particular conclusion you draw from the data is actually accurate? Counterfactual quarry: Is this other inference actually accurate or is it simply a delusion caused by incomplete data?"

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode