
Episode 01: Kelvin Guu, Google AI, on language models & overlooked research problems
Generally Intelligent
00:00
Is There a Paper That Breaks Your Intuition?
I think that the way that we incrementally work from working code onwards, is just an indication of the fact that we don't understand a lot of things that are going on. I can't actually think of a paper that broke my intuitions even forteperfectbut there was a paper about reordering the layers in the transformer. D you feel like seen any reason papers are recent things tat helpd make things click? Took it a little bit away from the heristic and a little bit closer to the like, oh, maybe i have some better intuition for how or why this is working.
Transcript
Play full episode