The Two Major Components of a Transformer Block

The two major capabilities that correspond to the two major components of what's called a transform work block. If you give it an input text of saying Shawshank, it will output redemption. But then language is only a little bit complex. You need another mechanism which is called attention. Once you stack them for a model that is large enough and train it on large enough data set, you can start to have these models that generate code that can summarize or write copywriting.

Transcript

Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!

Get the app