GPT-4 is not a giant library. A lot of the time it makes stuff up because it doesn't have a perfect memory. If you ask GPT-4 to write you a rap battle between Sireno de Bergerac and Vladimir Putin, even if there's no rap battle like that,. It can write it because it has picked up the rhythm of what are rap battles in general. But why would it then decide, I'm going to go make paperclips or do something in planning that is unrelated to my query? Or are we talking about a different form of AI that will come next? Well, I'll ask it to.