2 ms·
> "Running floating point array kernels on CPU cores seems pointless" This is true only for 32-bit or lower precision floating-point numbers. For 64-bit or hi
by adrian_b 4y ago
> "Running floating point array kernels on CPU cores seems pointless"
This is true only for 32-bit or lower precision floating-point numbers.
For 64-bit or higher precision floating-point numbers, which are required for the bulk of the scientific computation applications, CPUs are much better than the modern GPUs.
In the latest generation of both NVIDIA and AMD "consumer" GPUs, the throughput ratio of FP64 vs. FP32 has been reduced to 1:64. This ensures that these GPUs have both a performance per dollar and a performance per watt that are worse than those of CPUs.
The "datacenter" GPUs have excellent performance per watt, but their immense prices ensure that these GPUs either have a performance per dollar that is worse than that of CPUs (except for those who buy hundreds or thousands, to be used 24/7, so the savings in power consumption can balance the high acquisition cost) or even when the performance is so high that the ratio performance/price is similar to CPUs, the magnitude of the price is so great that it is far outside the range that can be afforded by a small business or by an individual.
More than a decade ago, NVIDIA claimed continuously that the GPUs will completely replace the traditional CPUs for all high-volume computations. Nevertheless, they themselves are those who have prevented this from happening, by segmenting the GPU market and raising the price of the 64-bit GPUs by more than an order of magnitude.
- cburdick2 4y agoI think you'd need to qualify what better means here. GPUs will give much higher performance for FP64 than CPUs will. The price of CPUs has continued to increase significantly in the last 5 years, and now high-end Xeons are more expensive than GPUs. Consumer GPUs aren't what you'd typically compare to since people doing large scientific simulations wouldn't use a desktop unless it's a very small model.
- moloch-hai 4y agoI am corrected.