5min chapter

Towards Data Science cover image

108. Last Week In AI — 2021: The (full) year in review

Towards Data Science

CHAPTER

Is There a Dance Between a Bigger and a Smaller Model?

There's this dance between compute getting cheaper, but also, at the same time, these algrams getting more efficient. mgogle just came out with their language modeon 25 x more efficient on a compute basis than previous models. And it's interesting to think of when the limit actually is hit, now that everyone is trying to just go as big as possible. As things get ynear, the rubber starts to meet the road more and more on applications, and it takes less n less expertise to leverage these things too.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode