The Transformer Architecture and the Future of Machine Learning

A breakthrough architecture called the Transformer came out in 2017 and essentially underlies all of the J&EI models that you see today. The different models work in kind of different ways, but the tools like Chad GPT and Bard from Google and Dolly all use that same Transformer architecture. And they do something that's called autoregressive. So for example, if you have an algorithm looking at some code that might say like import, bottle, three for example,. You're going to see that pattern over and over again.

Transcript

Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!

Get the app