5min chapter

The Changelog: Software Development, Open Source cover image

LLMs break the internet (Interview)

The Changelog: Software Development, Open Source

CHAPTER

The Cost of Scaling a Language Model

Simon: There was a fun tweet yesterday like gpt four they haven't said how big it is we know that three was 175 billion parameters they won't reveal how big four is somebody got a stopwatch and said okay well i'll ask the same question of three and four and time it and four took ten times longer to produce a result so i reckon four is ten times 175 billion parameters. Simon: If i could have the smallest possible model that's that can do this this pattern where it can call extra tools it can makeapi calls and so forth the stuff i could build with that is kind of incredible and it would run on my phone  that's the thing i'm most excited

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode