3 ms·
For deep learning workloads the software for posits isn't the issue, it's doing anything that's not NVIDIA if you want to do it as a standalone product. For NVI
by hedgehog 1y ago
For deep learning workloads the software for posits isn't the issue, it's doing anything that's not NVIDIA if you want to do it as a standalone product. For NVIDIA it's likely the penalty of not being able to share logic with standard size IEEE floats. If adopting posits allowed significantly smaller data types then NVIDIA would likely have adopted already.
- andrepd 1y agoBut 8-bit posits are actually a very nice alternative for deep learning, especially when using the quire for dot products!
- hedgehog 1y agoI don't disagree, it's just that the advantage hasn't yet been shown to be big enough to justify dedicating die area in a mainstream chip. There's potential there, if I were designing an accelerator today I would look hard at posits and variations of blocked representations especially around four bits. A few years back I got to have coffee with John Gustafson which was pretty neat and got me more excited about the idea.