Introduction

OpenAI uses GPT-4 to examine all the neurons of GPT-2 and figure out what they are linked to. They have a certain weight associated with them, which tells you basically how strongly they're going to fire when they fire. And then also they're all networked together in layers. That's the way in which each of these individual neurons is acting like a human neuron.