
Episode 01: Kelvin Guu, Google AI, on language models & overlooked research problems
Generally Intelligent
00:00
Is There a Future in Modeling?
I saw a theory paper on something similar, on generalization and memorization from iclear 20 21. Very similar idea about when do things memorize and how do they still generalize wich i gave a pretty interesting theoretical reason for it too. I think that now that we are getting models that very robustly have a lot of knowledge about the world, there should be an opportunity to use them more for tasks that you wouldn't traditionally think of as knowledge heavy tasks. And i'm thinking here of things more in reinforcement learning land. If you think about a human they can pick up a new game and figure out how to play that game relatively quickly, and they're drawing on a
Transcript
Play full episode