What Kinds of Things Do Count as Evidence in Math?

In mathematics, we make a distinction between such a guess that could be based on a lot of cases or evidence. And having a theorem or a proof, an argument, that tells you that it will work every case - even the ones you haven't tried. This is a statement that there's a reason why something is going to be true forever, for all time, in every case.