OpenAI's Neuronal Labeling

OpenAI managed to label every single neuron within GPT2 with what it refers to at each layer. The only maybe quibble that I would say, which you had to read pretty far into the fine print to determine was they were not super confident in some of their assessments. What it comes down to is that for a lot of neurons, they have an idea that this neuron points to the idea of Marvel or something like that.