5min chapter

Last Week in AI cover image

#128 - generative search, GPU black market, GPT-4’s Secret, Sam Altman’s World Tour

Last Week in AI

CHAPTER

The GPD4 Secret

GPD4 is based on a mixture of eight different models where each one of them is 220 billion parameters. If you lose the speaking, it's more than 1 trillion parameters. The idea of the transformer was around as of 2017 and arguably earlier in different forms. You can kind of think about base model as deciding like, "Oh, this is a sentence about French cuisine"

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode