4min chapter

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas cover image

230 | Raphaël Millière on How Artificial Intelligence Thinks

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

CHAPTER

Can We Decode the Internal Encodings of a Language Model?

Research is going beyond looking at the behavior of these models, and actually trying to make some stronger claims about the internal mechanisms that explain their behavior. That's a whole area of research that has come to be known as mechanistic interpretability in computer science and computational linguistics. We can take a leaf from the book of decades of research in neuroscience and psychology to try to understand the mechanisms of the black boxes that are the human mind or the human brain. The most refined kind of approach would be to look at toy models that are very, very small in terms of the number of parameters they have.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode