Generally Intelligent cover image

Episode 01: Kelvin Guu, Google AI, on language models & overlooked research problems

Generally Intelligent

00:00

Is There a Future in Modeling?

I saw a theory paper on something similar, on generalization and memorization from iclear 20 21. Very similar idea about when do things memorize and how do they still generalize wich i gave a pretty interesting theoretical reason for it too. I think that now that we are getting models that very robustly have a lot of knowledge about the world, there should be an opportunity to use them more for tasks that you wouldn't traditionally think of as knowledge heavy tasks. And i'm thinking here of things more in reinforcement learning land. If you think about a human they can pick up a new game and figure out how to play that game relatively quickly, and they're drawing on a

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app