4 ms·

I suppose in hindsight my example doesn't look as disturbing as it's meant to. :) It's hard to show concise examples that truly show how this little bit of err

I suppose in hindsight my example doesn't look as disturbing as it's meant to. :) It's hard to show concise examples that truly show how this little bit of error eventually compounds and destabilizes a calculation.

jobigoud 11y ago
I think he is referring to the fact that the result should be around 0.8999, not 8.9999.
jacquesm 11y ago
It looks plenty disturbing to me. I don't even think it should be qualified as a 'precision problem' it's more like a 'total failure'.