The Bayesian Conspiracy cover image

The Bayesian Conspiracy

Bayes Blast 13 – GPT-4 maps every neuron in GPT-2

May 16, 2023

10:49

Creator website

AI Chapters

Episode notes

1.

Introduction

2min

2.

The Problem With Transformers

2min

3.

OpenAI's Neuronal Labeling

2min

4.

AI and Alignment

2min

5.

The Importance of Interpretability in Deep Learning

4min

Blast with Matt re OpenAI using GPT-4 to automatically write explanations for the behavior of neurons in GPT-2, and what this means for Doom (spoiler: it’s good!) OpenAI’s explanation Thread – less than 1% of neuron’s explained with good confidence

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

App store banner

Play store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode