What Can Generative AI Do for Data People? (W/ Sarah Nagy + Chris Aberger)
The Analytics Engineering Podcast
00:00
The Transformer Architecture in Foundation Models
Transformers are the architecture piece. So it uses a mechanism called attention underneath, which basically allows you just to attend to certain parts of the data that you're feeding underneath. That's really the mathematical component or backbone of these architectures. It can apply to a wide variety of tasks because it's trained on this internet scale data that they have been set into it.
Transcript
Play full episode
