Building LLM Apps & the Challenges that come with it. The What's AI Podcast Episode 16: Jay Alammar
What's AI Podcast by Louis-François Bouchard
The Two Major Components of a Transformer Block
The two major capabilities that correspond to the two major components of what's called a transform work block. If you give it an input text of saying Shawshank, it will output redemption. But then language is only a little bit complex. You need another mechanism which is called attention. Once you stack them for a model that is large enough and train it on large enough data set, you can start to have these models that generate code that can summarize or write copywriting.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
