3 ms·
I am not sure why Ng seems to suggest he pioneered the use of GPUs for ML. It was pioneered by the Toronto lab led by Hinton, afaik.
by random314 5y ago
I am not sure why Ng seems to suggest he pioneered the use of GPUs for ML. It was pioneered by the Toronto lab led by Hinton, afaik.
- rsfern 5y agoIt seems like he was one of the people advocating using CUDA for deep learning before Krizhevsky’s big breakthrough in 2012. Not a primary source: https://medium.com/analytics-vidhya/gpu-for-deep-learning-7f4ef099b702 https://medium.com/analytics-vidhya/gpu-for-deep-learning-7f... Alex Krizhevsky’s home page has a bunch of CUDA ConvNet stuff from ~2010 https://www.cs.toronto.edu/~kriz/ https://www.cs.toronto.edu/~kriz/ Edit: found a better source. Deep learning on GPUs dates to 2005, and Ng’s group has the first GPGPU ConvNet report in 2009, and Krizhevsky has the breakthrough in 2011/2 https://www.deeplearningbook.org/contents/applications.html https://www.deeplearningbook.org/contents/applications.html