2 ms·
Single-precision is too expensive for GPUs, unfortunately.
by saagarjha 2y ago
Single-precision is too expensive for GPUs, unfortunately.
- alkonaut 2y agoI think you mean double precision?
- saagarjha 2y agoNo.
- alkonaut 2y agoCan you elaborate? Outside of AI workloads, almost all computations on GPUs are single precision. Double precision is pretty rare, and smaller precision is mostly useless outside AI (and obviously irrelevant for trig precision)
- saagarjha 2y agoUnfortunately almost all computations on GPUs are AI workloads.
- pclmulqdq 2y agoUh, what? The main usage of GPUs is graphics processing, and it's not even close. That is what Graphics Processing Units are built for. AI is probably the main use of datacenter GPUs today, but even that isn't "almost all" in comparison to the HPC work out there.
- pclmulqdq 2y agoThey may be too expensive for ML (or really not pareto-optimal for ML), but people use GPUs for a lot of things.