I heard a theory that the reason results were not deterministic for temperature 0 is that there is load-balancing between GPT4's experts across many users' requ

I heard a theory that the reason results were not deterministic for temperature 0 is that there is load-balancing between GPT4's experts across many users' requests, and each expert has different weights. This would explain some of the tradeoff between the price and the quality of the output. Another possibility is that that the price cuts come from weight quantization which can degrade quality.