
Episode 01: Kelvin Guu, Google AI, on language models & overlooked research problems
Generally Intelligent
00:00
Is There a Difference Between Incoding Knowledge and Text?
There's definitely a sense that entities are an important structure to aggregate facts around. I think text is obviously not natural, that there's no organic analogue of retrieving large amounts of text. But you can at least argue that people do the semi grounded simulation in their mind, like when they're planning. Even if things can be done in a completely uninterpretable, mural network black box, there's still some value in having intermediate grounded states. If we have short range plans about how to get a certain objective done, ideally you would be able to inspect what that plan like before it started executing.
Transcript
Play full episode