ChatGPT is intentionally nondeterministic for the same reason that GPT3 is nondeterministic by default. temperature>0 results in a better user experience. I'm h

ChatGPT is intentionally nondeterministic for the same reason that GPT3 is nondeterministic by default. temperature>0 results in a better user experience. I'm having a hard time understanding why you'd think a neural network could unintentionally be nondeterministic. If you want inference to be deterministic, just use the same seed every time. I also have no idea what your spam emails has to do with training models. The linked law prevents companies in the EU from releasing or deploying large models. It does not prevent grifters from spamming you. (not that there are any companies in the EU training state of the art models, but that's a separate issue)