Generally Intelligent cover image

Episode 01: Kelvin Guu, Google AI, on language models & overlooked research problems

Generally Intelligent

00:00

Is There a Paper That Breaks Your Intuition?

I think that the way that we incrementally work from working code onwards, is just an indication of the fact that we don't understand a lot of things that are going on. I can't actually think of a paper that broke my intuitions even forteperfectbut there was a paper about reordering the layers in the transformer. D you feel like seen any reason papers are recent things tat helpd make things click? Took it a little bit away from the heristic and a little bit closer to the like, oh, maybe i have some better intuition for how or why this is working.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app