AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Stacastic Parots, Are They Really Using Statistical Models?
We do seem to understand that these large language mouths are largely stacastic parots. The question is whether they've gone far enough in that direction to get to the point where they would count as systems with genuine understanding. And around this point we come up against the very hard question of what counts as genuine understanding. As you say, phenomenal consciousness might not even be enough here. Merely having a feeling of understanding might not be genuine understanding. But we don't want to just simply operationalize understanding andto into a behavior capacity. We need better tools for understanding what's going on inside these systems.