AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
5min chapter
Eric Michaud on scaling, grokking and quantum interpretability
The Inside View
The Functional Unit of a Deep Neural Network
In your paper with Quanta, you talk about things being discrete. So I'm kind of curious, what do you mean by discrete in these kind of scenarios? When everything is floating point, I really think. Ah, yeah, that's a great question. Yeah, so I guess maybe there are a couple high level models you could have for thinking about what neural networks are doing and what they consist of. Maybe an example of something that feels more discrete, an algorithm in the network is the circuit that does induction.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode