GPT-4 with Matt Browne
Embrace The Void
00:00
Fours Memory Improves Significantly
The technology is not adaptive, like it doesn't do online learning. It feels adaptive because it has a short term memory when you're dialoguing with it. So it has that awareness of like the recent context, but the actual underlying model is very much fixed. As well as being smarter, it's also got a much bigger short-term memory. And they've recently figured out some clever little tricks to basically compress the history into, into some code so it can be expanded pretty easily.
Transcript
Play full episode
