AXRP - the AI X-risk Research Podcast cover image

19 - Mechanistic Interpretability with Neel Nanda

AXRP - the AI X-risk Research Podcast

CHAPTER

Using GPT-2 to Find a Neuron

I want us to get a lot better at finding circuits this involves a lot of things having good infrastructure so you can just find the common things you do a bunch and do them really fast. Then there's understanding the tools we already have where do they break what are the ways you might apply them and then actually shoot yourself in the foot. The final axis is how much things are kind of automatable and scalable versus super labor intensive and painstakingly staring at neurons and looking at weights I don't know that's like roughly how I break down the field of like how to think about techniques and tools okay.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner