GPUs, When Did They Come on the Scene?

When did GPUs come on the scene? I'm trying to remember that must have been. Let's see, 2000 around 2000 or so. So then there was a 10 year period before that was sort of breakthrough work done and you're on that space on CUDA. They picked it up very early. Jan Lecun at one of the CFAR meetings said that he has a graduate student who was hacking and that it looked very promising. And so, yeah, as soon as they got that up in running, everybody with neural networks realized that this was like exactly the right architecture for the problems that we have.