Suppose you want to use say 100 GPUs for LLM training but you can’t buy them because the US doesn’t allow them to be sold in your country. Say you can readily

Suppose you want to use say 100 GPUs for LLM training but you can’t buy them because the US doesn’t allow them to be sold in your country. Say you can readily get CPUs that are 1/100th the TFLOPS of the GPUs. Could you use 10000 of the CPUs and get performance on LLM training similar to what the 100 GPUs would have given?