4 ms·
It is not so much a "chip that powerful" but a "chip that correct". Gaming GPUs are allowed errors because the rendered images are known to be visual output onl
by bsenftner 9y ago
It is not so much a "chip that powerful" but a "chip that correct". Gaming GPUs are allowed errors because the rendered images are known to be visual output only, whereas an engineering GPU may be used for hard analysis, which cannot afford any rounding or other classes of the acceptable errors gaming GPUs are allowed.
- eloff 9y agoAre you talking about double-precision floating point math? Or are you saying the gaming chips actually have issues?
- jackmott 9y agoIt is just complete nonsense. In fact deep learning/AI chips used for neural networks usually have reduced floating point precision because they don't need it.
- smitherfield 9y agoDeep learning is still a fairly new and small field, scientific computing workloads are usually mostly double-precision.
- freeone3000 9y agoWe don't need it because errors in any particular value aren't important - the calculations assume an amount of inherent error greater than that produced by the hardware.
- jackmott 9y agononsense
- tomsmeding 9y agoDo you have a source for those claims? It seems highly unlikely to me that certain types of cpu's or gpu's are allowed errors to cut costs. Rounding mechanics are complicated, but I'd say a bug is a bug. As mentioned in a comment by jackmott in this thread, "engineering purposes" also often actively reduce precision for increased performance.
- dijit 9y agoDouble precision floating point and the addition of ECC memory. In the case of nVidia the quadro cards are the only ones sold as manufactured by the company and are incredibly high binned. Lots of people on this thread are conflating a few things such as ML, but I work in an industry where we deal a lot with GPUs and its certainly a fact that flipped bits are significantly more common than many think. If you do any work that requires the output to be nonvolatile then you can run into issues.
- NoPiece 9y agoPerhaps he is referring to ECC memory - high end pro model NVIDIA cards have it, and consumer cards don’t. Here is a paper showing that there are memory errors on the consumer non-ecc cards. http://ieeexplore.ieee.org/document/5493404/?arnumber=5493404&tag=1 http://ieeexplore.ieee.org/document/5493404/?arnumber=549340...