2 ms·
I would also think that GPU workloads have something to do with it. Almost none are serial workflows, and instead highly parallel work. GPU workloads will even
by pixl97 4y ago
I would also think that GPU workloads have something to do with it. Almost none are serial workflows, and instead highly parallel work.
GPU workloads will eventually run into the same scaling limits. That is we will be unable to speed up each execution unit any further, or the primary work we give the GPU will not be able to be split into more threads and accomplish useful work.
- qayxc 4y agoGood point about the workload. On the other hand, typical GPU tasks seem to be scalable basically ad-infinitum as graphics moved from fixed-function pipelines to per-pixel shaders to raytracing and path tracing. So maybe GPUs still have some room until they run into the same problem as CPUs.
- pklausler 4y agoMulti-GPU nodes with fast coherent interconnects exist.