Deep Learning - The Three Key Ingredients That Made Deep Learning Practical

The three key ingredients that have made deep learning practical are big data and parallelization. If you don't have enough examples to teach the neural network, there's nothing to learn from. NVIDIA invented the CUDA programming model which allowed researchers to run their algorithms on a GPU at orders of magnitude faster than they ever thought was possible.