4 ms·
Why are they nondeterministic? You can use a fixed seed or temperature=0.
by chpatrick 11mo ago
Why are they nondeterministic? You can use a fixed seed or temperature=0.
- datadrivenangel 11mo agoThe whole point of "agentic AI" is that you don't have to rigorously test every potential interaction, which means that even a temperature zero model may behave unexpectedly, which is bad for security.
- urbandw311er 11mo agoEven with zero temperature (and some of the latest models don’t allow that) you’re still not absolutely guaranteed deterministic output.
- deleted 11mo ago[deleted]
- ares623 11mo agoJust repeatable output.
- chpatrick 11mo agoWhat does deterministic mean in this case?
- jrm4 11mo agoRight, I'm using a perhaps loose definition of deterministic here, as in -- "With AI tools, you cannot 100% predict any output based on input, the way you can with most programming."
- chpatrick 11mo agoIt's also kind of an impossible request given that AI tools are for generic unpredictable input.