Just a nit pick, generally we refer to it as SIMD - Single instruction multiple data[1]. In reality today most CPUs have vector processing instructions and GPUs

Just a nit pick, generally we refer to it as SIMD - Single instruction multiple data[1]. In reality today most CPUs have vector processing instructions and GPUs have lots of groups of SIMD units so both CPUs and GPUs are MIMD, GPUs are just much further along on the Instruction:Data ratio. [1]:https://en.wikipedia.org/wiki/Flynn%27s_taxonomy https://en.wikipedia.org/wiki/Flynn%27s_taxonomy