Deep learning is the powerhouse behind the AI industry that enables AI to learn by itself, powered by GPUs that are designed to run machine learning algorithms at scale. However, the invention of deep learning was based on hardware that was not explicitly intended for this type of computing. Nvidia CEO Jensen Huang revealed on the Joe Rogan podcast that researchers who first developed deep learning did it all on a pair of 3GB GTX 580s in SLI way back in 2012.
Researchers at the University of Toronto invented deep learning to improve image detection in computer vision. In 2011, Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton were researching better ways to build image recognition tools. At the time, there was no such thing as a neural network; instead, developers used manually designed algorithms to detect edges, corners, and textures for image recognition.
