My primary task isn't ML, and 64bit is needed for numerical stability. For the Titan V, the F64 was 1/2 of F32, it was the only and last consumer generation to

My primary task isn't ML, and 64bit is needed for numerical stability. For the Titan V, the F64 was 1/2 of F32, it was the only and last consumer generation to have that. For Titan RTX and newer NVIDIA cards, the ratio from F32 to F64 is typically 1/64th of FP32. So the Titan RTX, with 16 FP32 TFlop/s drops to 0.5 FP64 TFlops/s While the Titan V, starting at 15 FP32 TFlops/s still has 7.5 FP64 TFlops/s The 5090 TI has 104.9 FP16/32 TFlops/s, but only 1.64 FP64 TFlops/s. Basically Nvidia decided most people didn't need FP64, and chose to improve quantized performance instead. If you can run on a GPU, that Titan V has more 64bit Flops than even an AMD Ryzen Threadripper PRO 7995WX.