4 ms·
The most important new code is massively parallel. Using GPUs today but surely new architectures soon. The human brain is highly parallel, so no surprise there.
by paulsutter 11y ago
The most important new code is massively parallel. Using GPUs today but surely new architectures soon. The human brain is highly parallel, so no surprise there.
Look how tiny the source code to Deepmind's general Atari player. It's a completely different model from traditional development:
https://sites.google.com/a/deepmind.com/dqn/ https://sites.google.com/a/deepmind.com/dqn/
- sushirain 11y agoYou are right. If deep learning takes more and more of the processing, we will need GPUs or more CPU cores, not necessarily clock speed.