Eye On A.I. cover image

#123 Aidan Gomez: How AI Language Models Will Shape The Future

Eye On A.I.

00:00

The Transformer Algorithm

At that time, nothing existed. Truly nothing existed. It was all eroded yourself. Nowadays, it's probably closer to 20 lines of code. Really extremely simple. The basic layer is called like a MLP. And really, the transformer is like the simplification, but it's just some MLPs stacked on top of each other, plus an attention line.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app