Catherine Olsson and Nelson Elhage: Anthropic, Understanding Transformers
The Gradient: Perspectives on AI
00:00
Induction Heads
Induction heads looks at this pot token, POT and then finds a previous instance of potters. It's kind of like copy pasting from the past to make things easy. And I think importantly, they're doing it in the present context.
Transcript
Play full episode
