AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Future of Context Windows
The question is say that you had a billion token context windows that big enough, like where does it asymptote in terms of value? You can think of it in a few different ways. Like how many tokens do you need to represent all the data that's relevant to a person relative to a specific query that you're worried about relative to PII or other sensitive information? And so I agree like the windows will get bigger and bigger and bigger,. But eventually some of these things asymptotes, and they take years or decades to asymptotal.