When I hear someone speak, their accent immediately gives me lots of associations. Just the sound of somebody's voice might tell me a few things about that person. Learners of English don't know if someone is from the north or south of England and what social class they might come from. But native speakers do know these things. We shouldn't really judge someone just by the way that they speak.