The Gradient: Perspectives on AI cover image

Catherine Olsson and Nelson Elhage: Anthropic, Understanding Transformers

The Gradient: Perspectives on AI

CHAPTER

Toy Transformers - How Do You Even Try to Do This?

A team of researchers has developed a new way to analyze toy transformers. They started from the smallest possible case and then incrementally layer pieces back in. The result is that they can sort of reason about each of them kind of independently.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner