4 ms·
Nvidia is cracking along. "Nvidia’s GPUs today are 25 times faster than five years ago. If they were advancing according to Moore’s law, he said, they only woul
by tim333 9y ago
Nvidia is cracking along. "Nvidia’s GPUs today are 25 times faster than five years ago. If they were advancing according to Moore’s law, he said, they only would have increased their speed by a factor of 10." https://spectrum.ieee.org/view-from-the-valley/computing/hardware/move-over-moores-law-make-way-for-huangs-law https://spectrum.ieee.org/view-from-the-valley/computing/har...
I find it interesting that they are crossing the levels proposed for human equivalence around now depending on how you figure it - Moravec figured about 100 terraflops and you can now get "118.5 teraflops tensor-based deep learning performance" from "The Quadro GV100 is available now on nvidia.com for $8,900" https://www.hpcwire.com/2018/03/27/nvidia-brings-the-power-of-volta-to-workstations-with-new-quadro/ https://www.hpcwire.com/2018/03/27/nvidia-brings-the-power-o... https://www.jetpress.org/volume1/moravec.htm https://www.jetpress.org/volume1/moravec.htm
Just need a bit of software.
- Dylan16807 9y agoAny improvement like that is from the GPU being given different kinds of circuits entirely. The raw performance difference is not very impressive. In late 2012 you'd get about 8 gigaflops per dollar. Late 2017 gets you almost double that. They're being used somewhat more effectively, but a normal non-neural-net benchmark shows a total performance improvement of... 3x. They're doing better than CPUs but they're still falling behind Moore's law.
- marcofatica 9y ago> a normal non-neural-net benchmark shows a total performance improvement of... 3x because they aren't intended to run non-neural-net workloads. you don't judge a dishwasher by it's ability to wash your clothes, do you?
- Dylan16807 9y agoWhen you're judging whether Moore's law is dead, you need to separate out the improvements from changing the FPU layout and the improvements from lithography. And since the consumer chips don't dedicate a lot of space to neural net units, they're the best baseline. It's cool that they made some neural net things go hugely faster. But they could make the same fundamental chip on 6-year-old foundries, only slower by a factor of 2 or 3. That really impressive number has nothing to do with Moore's law.