3 ms·
Bill Dally from nvidia introduced a log representation that basically allows to replace a multiplication with an add, without loss of accuracy (in contract to p
by cpldcpu 2y ago
Bill Dally from nvidia introduced a log representation that basically allows to replace a multiplication with an add, without loss of accuracy (in contract to proposal above)
https://youtu.be/gofI47kfD28?t=2248 https://youtu.be/gofI47kfD28?t=2248
- nickpsecurity 2y agoPaper? https://research.nvidia.com/publication/2022-12_lns-madam-low-precision-training-logarithmic-number-system-using-multiplicative https://research.nvidia.com/publication/2022-12_lns-madam-lo...