What Does Solve the Problem Mean?

The question is what does solve the problem mean? Because for example, with chat GPT, if the problem is write a high school level essay, then, you know, which is again, a very fuzzy threshold. I think we're beginning to understand them, but it's not the metric we're going to use and that might be having to do with information theory or something.