4 ms·
I agree that scale is an important factor in deep learning's success, but that Google experiment ended up being a good example of how not to do it. They used 16
by lars 10y ago
I agree that scale is an important factor in deep learning's success, but that Google experiment ended up being a good example of how not to do it. They used 16000 CPU cores to get that cat detector. A short while later, a group at Baidu were able to replicate the same network with only 3 computers with 4 GPUs each. (The latter group was also lead by Andrew Ng.)
- espadrine 10y agoIncidentally, seeing the speaker set up an overkill neural network for a trivial classification problem seemed off to me. Unsurprisingly, at least 75% of the neurons were unused. Throwing a phenomenal amount of neurons at a problem is not a goal; using a minimal amount to solve it in a given time budget is. The statement at the end of the video, “all the serious applications from here on out need to have deep learning and AI inside”, seems awfully misguided. Even DeepMind doesn't use deep learning for everything.