2min chapter

The Analytics Engineering Podcast cover image

What Can Generative AI Do for Data People? (W/ Sarah Nagy + Chris Aberger)

The Analytics Engineering Podcast

CHAPTER

ML Foundation Models - What Are They?

When I was doing my PhD at Stanford, most AI researchers were actually looking at selecting a bunch across a bunch of different models. But an important thing that happened around 2017, 2018, were these transformer architectures that came out. These just use the mechanism called attention and are really efficient to run on GPUs. They kind of took off and took over the landscapes and the ML community all collapsed in around 2018.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode