5 ms·
I think there's been some tendency against things like HogWild in favor of reproducibility and (its close cousin) debug-friendliness.
by sdenton4 1y ago
I think there's been some tendency against things like HogWild in favor of reproducibility and (its close cousin) debug-friendliness.
- blt 1y agoUnderstandable. However, I went down that rabbit hole once, and learned that even summing a 1D array with a GPU is nondeterministic (because it is broken down like merge sort and subject to the scheduler). I guess I assumed that practitioners had fully embraced randomness due to things like that.