2min chapter

The Changelog: Software Development, Open Source cover image

LLMs break the internet (Interview)

The Changelog: Software Development, Open Source

CHAPTER

The Limits of Language Models

Is there a theoretical limit to the side i mean is there a law of diminishing returns i assume there would be like how large can the language models get if you just continue to just throw more and more at it does it just get better and better or is eventually just top out. I want the smallest possible language model that i can run on my own device that can still do the magic it can summarize things and extract facts and generate bits of code  and all of that sort of stuff. The limitation right now is more the expensive running themlike if you made a gpt five that was ten times the size of gpt four and cost ten times as much much to rundoes that actually

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode