>I assume 10 cores would perform as well as 1 GPU Transformers are very easily parallelizable. Take a look at H100 https://www.nvidia.com/en-us/data-center/te

>I assume 10 cores would perform as well as 1 GPU Transformers are very easily parallelizable. Take a look at H100 https://www.nvidia.com/en-us/data-center/technologies/hopper-architecture/ https://www.nvidia.com/en-us/data-center/technologies/hopper... It has 18482 CUDA cores, which for the purposes of the discussion means 18482 multiplications in parallel. They also have tensor cores, which make everything faster several times, i.e. these are essentially special hardware for matrix multiplications. We could use AVX512 to make many multiplications in parallel (i.e. 512/32 = 16 or 512/64 = 8) on each CPU core, but it wouldn't compare. GPU still wins.