3min chapter

The Thesis Review cover image

[11] Jacob Andreas - Learning from Language

The Thesis Review

CHAPTER

The Tension Between Language and Policy Learning

I think the tension there is between models with an explicit recursion operation and like RNNs with adaptive computation time but no additional structure. And so you know I guess to the extent that those are kind of the two the two problems that have always been really useful for me just like sharpening my intuition about models can do and can't do right now instruction following and question answering. Yeah yeah I see. So maybe to go on to the these policy sketches I guess like one thing to maybe start on is that this now brings in reinforcement learning or policy learning. It's important to be very clear that we're not talking about natural language here we're talking about sort of synthetic highly structured highly

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode