Quantized floating point math can, under certain scenarios, be non-associative. When you combine that fact with being part of a diverse batch of requests over

Quantized floating point math can, under certain scenarios, be non-associative. When you combine that fact with being part of a diverse batch of requests over an MoE model, outputs are non-deterministic.