LLM can be made deterministic too, they’re just generally not because the element of randomness is a feature. There’s a big difference between deterministic an

LLM can be made deterministic too, they’re just generally not because the element of randomness is a feature. There’s a big difference between deterministic and smooth though. Typical LLMs certainly aren’t reliably smooth, so the small prompt change might product a large and unpredictable output change. I’m not sure if that’s any better with the typesafe approach.