Performance/watt is improving greatly! Look at this plot [1] from about 2013 showing the theoretical perf/w of CPUs up to Ivy Bridge, and GPUs up to NVIDIA Kepl

Performance/watt is improving greatly! Look at this plot [1] from about 2013 showing the theoretical perf/w of CPUs up to Ivy Bridge, and GPUs up to NVIDIA Kepler GK110 and AMD Hawaii XT. Since than both Intel with Haswell (and Skylake on Desktop) as well as NVIDIA Maxwell and AMD Fiji have improved tremendously The same article [3] shows clearly [2] that max TDP has increased a bit. [1] https://www.karlrupp.net/wp-content/uploads/2013/06/gflops-per-watt-sp.png https://www.karlrupp.net/wp-content/uploads/2013/06/gflops-p... [2] https://www.karlrupp.net/wp-content/uploads/2013/06/tdp.png https://www.karlrupp.net/wp-content/uploads/2013/06/tdp.png [3] https://www.karlrupp.net/2013/06/cpu-gpu-and-mic-hardware-characteristics-over-time/ https://www.karlrupp.net/2013/06/cpu-gpu-and-mic-hardware-ch...