3 ms·
A lot of hardware has built in RNGs, but even using a software algorithm (eg Xorshift) is extremely inexpensive. Also, sometimes you’re not limited by processi
by KMnO4 2y ago
A lot of hardware has built in RNGs, but even using a software algorithm (eg Xorshift) is extremely inexpensive.
Also, sometimes you’re not limited by processing speed, but by the destination data structure (eg quantized to integers).
https://en.wikipedia.org/wiki/Xorshift https://en.wikipedia.org/wiki/Xorshift
- vlovich123 2y agoI'm aware of fast RNGs, but even compared to HW floating point operations, I believe they're still more expensive than Khan summation. HW circuits maybe could do well. I see that most of the interest is around LLMs and doing quantized sums (gathering from the fact that Intel has shipped this in their accelerator), but this came up in the WiFi positioning code I was working on 10 years ago (we were using "classical" f64).