3 ms·
Floating point math isn't associative for operations that are associative in normal math.
by pertymcpert 8mo ago
Floating point math isn't associative for operations that are associative in normal math.
- measurablefunc 8mo agoThat would just add up to statistical noise instead of 10% degradation over a week.
- kevin_thibedeau 8mo agoCatastrophic error accumulation can produce more profound effects than noise.
- measurablefunc 8mo agoJust to make sure I got this right. They serve millions of requests a day & somehow catastrophic error accumulation is what is causing the 10% degradation & no one at Anthropic is noticing it. Is that the theory?
- pertymcpert 8mo agoFYI something in that region happened last august/September. Some inference bug triggered worse performance on TPUs vs GPU.