3 ms·
What about stochastic rounding as used in many quantized neural network implementations :).
by gliptic 5y ago
What about stochastic rounding as used in many quantized neural network implementations :).
- ChrisLomont 5y agoLeads to non-reproducible or non-portable software. It's better to have well-defined and reproducible behavior, so one can reason how to make correct algorithms. Neural networks do it for very precise reasons nearly unique to them. If they were built on randomly rounding primitives, and that random was not the precise flavor one model or another needed, then you'd not easily be able to get the distributions needed for the task.