The Analytics Engineering Podcast cover image

What Can Generative AI Do for Data People? (W/ Sarah Nagy + Chris Aberger)

The Analytics Engineering Podcast

CHAPTER

ML Foundation Models - What Are They?

When I was doing my PhD at Stanford, most AI researchers were actually looking at selecting a bunch across a bunch of different models. But an important thing that happened around 2017, 2018, were these transformer architectures that came out. These just use the mechanism called attention and are really efficient to run on GPUs. They kind of took off and took over the landscapes and the ML community all collapsed in around 2018.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner