AXRP - the AI X-risk Research Podcast cover image

19 - Mechanistic Interpretability with Neel Nanda

AXRP - the AI X-risk Research Podcast

CHAPTER

What's the Difference Between Sensory Reasoning and Processing?

Sensory reasoning in motor motor is a good description of what the neurons are doing but it also spends a significant amount of its computation on attention. The model first roots the separate tokens of the phrase the Eiffel tower to the final token and then looks up the fact that it's in Paris. This information can be rooted around like several times for example there was this great work by David bound kevin mange looking at how models did factual recall.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner