4 ms·
The point is that integer weights allow for incremental updates to be correct. If you used floats then they would drift away from correct as you applied more in
by dan-robertson 6y ago
The point is that integer weights allow for incremental updates to be correct. If you used floats then they would drift away from correct as you applied more incremental updates. And neural networks can be quite sensitive to small errors
- eutectic 6y agoWith 32 bits of precision I don't see it being a big problem over a maximum of say 50 moves. Neural networks which are not overfit should be tolerant of a small amount of random (not crafted) noise.
- deleted 6y ago[deleted]
- recursive 6y ago64-bit floats have 53 bits of precision. 32-bit floats have 24. The rest goes into sign and exponent.
- dan-robertson 6y agoMaybe the network uses integers for other reasons. Perhaps due to the history of the program. I don’t know how the search works but I would imagine it would consider more than 50 moves with lots of backtracking and trying different possible moves.