The advantage of this is to move things closer together and lower latency. If that means running at a lower clock rate in order to keep heat under control, that

The advantage of this is to move things closer together and lower latency. If that means running at a lower clock rate in order to keep heat under control, that may be an acceptable tradeoff. Different problems benefit differently from low latency vs high throughput. A high throughput machine like a GPU is fantastic for crushing giant matrices due to massive parallelism. On the other hand, an extremely low latency machine is what you want for traditional programs that are full of nondeterminism. There you want as much fast memory to be as close to the CPU as possible so that you’re not waiting as long every time you get a cache miss.