19 ms·

Did he talk much about performance per watt? The trend with recent NV GPUs seems to be to increase performance but at the cost of ever-increasing power budgets;

by mrec 11y ago

Did he talk much about performance per watt? The trend with recent NV GPUs seems to be to increase performance but at the cost of ever-increasing power budgets; I'm starting to despair of ever getting anything that'll meet the Oculus reqs without sounding like a 747 taking off and/or melting a hole in the table.

irremediable 11y ago
Afraid not. He was talking to a load of machine learning researchers who want to use the chips for CUDA stuff, for whom power consumption isn't an issue.
exDM69 11y ago
Perf per watt has improved with every NV GPU generation and quite significantly. But it's true that the max TDP has increased too (but you get more in return).
yvdriess 11y ago
GPUs are in an interesting place. They were not able to scale under 28nm due to the increased static leakage. Intel CPUs were able to scale because of dynamic power management, but GPUs cannot really use the same trick. It's only with the upcoming 16nm GPU generation that they got static leakage to a place where we see an actual new generation of GPU hardware. It's been about 5 years now of 28nm + GDDR4.
- thesz 11y ago
  The lengths you mentioned are lambdas - factors for on-die features. This means that some part of the transistor cannot be smaller than lambda-size square. Usually, they are much bigger and often are of equal size even for wastly different lambdas. Here's a table for SPARC CPUs, with process lambda, die size and transistor count: https://en.wikipedia.org/wiki/SPARC#SPARC_microprocessor_implementations https://en.wikipedia.org/wiki/SPARC#SPARC_microprocessor_imp... If transistors would reduce with lambda, then for two-fold reduction you would get four fold increase of density. Difference in density between T4 and T2 (90 and 40 hn processes) is less than two. The static leakage you mentioned is mainly due to sizes of transistor parts. You should also know that NVidia uses humans as chip designers (they can afford that), not an automatic process like some fabless companies use. And now I get to my main point: NVidia overshot with 28nm and got transistors features that were too small, probably, due to not all that good software they used to calculate models. They continue to overshoot for 5 years until they corrected their overshoot. It has nothing to do with process lambda. It is process error in NVidia.
douche 11y ago
I just upgraded from a GTX 560 to a 960, and I've more than doubled my performance, and nearly halved the number of watts I draw, so it's not all bad.
slizard 11y ago
Performance/watt is improving greatly! Look at this plot [1] from about 2013 showing the theoretical perf/w of CPUs up to Ivy Bridge, and GPUs up to NVIDIA Kepler GK110 and AMD Hawaii XT. Since than both Intel with Haswell (and Skylake on Desktop) as well as NVIDIA Maxwell and AMD Fiji have improved tremendously The same article [3] shows clearly [2] that max TDP has increased a bit. [1] https://www.karlrupp.net/wp-content/uploads/2013/06/gflops-per-watt-sp.png https://www.karlrupp.net/wp-content/uploads/2013/06/gflops-p... [2] https://www.karlrupp.net/wp-content/uploads/2013/06/tdp.png https://www.karlrupp.net/wp-content/uploads/2013/06/tdp.png [3] https://www.karlrupp.net/2013/06/cpu-gpu-and-mic-hardware-characteristics-over-time/ https://www.karlrupp.net/2013/06/cpu-gpu-and-mic-hardware-ch...

by mrec 11y ago

irremediable 11y ago

Afraid not. He was talking to a load of machine learning researchers who want to use the chips for CUDA stuff, for whom power consumption isn't an issue.

exDM69 11y ago

Perf per watt has improved with every NV GPU generation and quite significantly. But it's true that the max TDP has increased too (but you get more in return).

yvdriess 11y ago

GPUs are in an interesting place. They were not able to scale under 28nm due to the increased static leakage. Intel CPUs were able to scale because of dynamic power management, but GPUs cannot really use the same trick. It's only with the upcoming 16nm GPU generation that they got static leakage to a place where we see an actual new generation of GPU hardware. It's been about 5 years now of 28nm + GDDR4.

thesz 11y ago
The lengths you mentioned are lambdas - factors for on-die features. This means that some part of the transistor cannot be smaller than lambda-size square. Usually, they are much bigger and often are of equal size even for wastly different lambdas. Here's a table for SPARC CPUs, with process lambda, die size and transistor count: https://en.wikipedia.org/wiki/SPARC#SPARC_microprocessor_implementations https://en.wikipedia.org/wiki/SPARC#SPARC_microprocessor_imp... If transistors would reduce with lambda, then for two-fold reduction you would get four fold increase of density. Difference in density between T4 and T2 (90 and 40 hn processes) is less than two. The static leakage you mentioned is mainly due to sizes of transistor parts. You should also know that NVidia uses humans as chip designers (they can afford that), not an automatic process like some fabless companies use. And now I get to my main point: NVidia overshot with 28nm and got transistors features that were too small, probably, due to not all that good software they used to calculate models. They continue to overshoot for 5 years until they corrected their overshoot. It has nothing to do with process lambda. It is process error in NVidia.

douche 11y ago

I just upgraded from a GTX 560 to a 960, and I've more than doubled my performance, and nearly halved the number of watts I draw, so it's not all bad.

slizard 11y ago

Performance/watt is improving greatly! Look at this plot [1] from about 2013 showing the theoretical perf/w of CPUs up to Ivy Bridge, and GPUs up to NVIDIA Kepler GK110 and AMD Hawaii XT. Since than both Intel with Haswell (and Skylake on Desktop) as well as NVIDIA Maxwell and AMD Fiji have improved tremendously The same article [3] shows clearly [2] that max TDP has increased a bit. [1] https://www.karlrupp.net/wp-content/uploads/2013/06/gflops-per-watt-sp.png https://www.karlrupp.net/wp-content/uploads/2013/06/gflops-p... [2] https://www.karlrupp.net/wp-content/uploads/2013/06/tdp.png https://www.karlrupp.net/wp-content/uploads/2013/06/tdp.png [3] https://www.karlrupp.net/2013/06/cpu-gpu-and-mic-hardware-characteristics-over-time/ https://www.karlrupp.net/2013/06/cpu-gpu-and-mic-hardware-ch...