Plus, main idea of GPU, their "Computing Unit" is not alone. Mean, in CPU could cut any core and it will work completely separated without other cores. In GPU

Plus, main idea of GPU, their "Computing Unit" is not alone. Mean, in CPU could cut any core and it will work completely separated without other cores. In GPU, typical, have blocks for example 6x CUs, which have one pipeline for all, and this is how they achieve thousand CUs or more. So, all CUs basically run same program, in some architectures could make limited independent branching with huge penalties on speed, but mostly just one execution path for all CUs. Very similar to SIMD CPU, even some GPUs was basically SIMD CPUs with extremely wide data bus (or even just VLIW). So, GPU cache sure optimized for such usage, it provide buffer wide enough for all CUs on same time.