3 ms·
If your algorithm uses reduce-like ops for float values and is run on a GPU, your results won't be deterministic even with controlled RNG seeds, since floating
by heyitsguay 7y ago
If your algorithm uses reduce-like ops for float values and is run on a GPU, your results won't be deterministic even with controlled RNG seeds, since floating point addition is non-commutative.
- paulgb 7y agoAs long as the order of non-commutative operations is deterministic, this isn't a problem though, right?
- heyitsguay 7y agoIf the order were deterministic that would be true, but I haven't found any solutions to control GPU task scheduling at that level. Maybe one exists? I don't know enough about low-level GPU coding to say.