Using GPUs to Train Neural Networks

The history of machine learning is interesting because there was, there were maybe a few kind of landmark results at several different points. A lot of what was happening I think was just this kind of gradual increasing snowballing interest in oh wait maybe this will actually work if we sort of lean into it enough. The one big precipitating discovery would actually be something that's almost completely outside of NLP and outside of anything that I have an expertise in which was the idea of using GPUs to train neural networks.