3 ms·
I was going to suggest that the result was bad because of floating point error, but then I reread the value and, it doesn't seem like that amount of variance co
by fao_ 7y ago
I was going to suggest that the result was bad because of floating point error, but then I reread the value and, it doesn't seem like that amount of variance could be produced by errors introduced in the floating point calculations?
- patrec 7y agoYou sum 7 numbers all around 100. Assuming I didn't mess up, the maximal floating point error for that is ~100·7·2^-53 which is < 10^-13.