
19 - Mechanistic Interpretability with Neel Nanda
AXRP - the AI X-risk Research Podcast
What's the Difference Between Sensory Reasoning and Processing?
Sensory reasoning in motor motor is a good description of what the neurons are doing but it also spends a significant amount of its computation on attention. The model first roots the separate tokens of the phrase the Eiffel tower to the final token and then looks up the fact that it's in Paris. This information can be rooted around like several times for example there was this great work by David bound kevin mange looking at how models did factual recall.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.