The question is say that you had a billion token context windows that big enough, like where does it asymptote in terms of value? You can think of it in a few different ways. Like how many tokens do you need to represent all the data that's relevant to a person relative to a specific query that you're worried about relative to PII or other sensitive information? And so I agree like the windows will get bigger and bigger and bigger,. But eventually some of these things asymptotes, and they take years or decades to asymptotal.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode