Thanks @wmf @dahart for the discussion. You are both right: - I can't just buy 3080 and stuff it into my servers due to legal. - I can't just buy 3080 and st

Thanks @wmf @dahart for the discussion. You are both right: - I can't just buy 3080 and stuff it into my servers due to legal. - I can't just buy 3080 and stuff it into my servers due to availability. - Often (as the example I given) the price-to-performance of GPU is not worth the cost of porting software. - Often (as the example I given) the price-to-performance of GPU is not super competitive with CPU. - Sometimes, you can make the math work. Either by picking a problem which GPU excels at (memory speed, single precision, etc), or by picking consumer grade GPU or by having access to cheap/used datacenter grade GPU's. - In the example I given, even with cheap 3080, and say 20-30x better perf/dollar ratio of GPU's.... is it still worth it? It's not like my servers are calculating euclidean distance for 100% their CPU. The workload is diverse, nginx, dns, database, javascript. There is a bit of heavy computation, but it's not 100% of workload. In order to get GPGPU to pay for itself it would need to take over a large portion of load, which, in general case is not possible. So, I would take GPU into consideration if it was 200x-1000x better per dollar then CPU, then I could make a strong financial argument. The point I was trying to make, is that GPU's are a good fit for a small fraction of computer workloads. For them to make sense: - more problems would need to fit on them - or the performance/dollar would need to improve further by orders of magnitude