“This doesn't make sense as long as LLMs are non-deterministic.” I think this is a logical error. Non-determinism is orthogonal to probability of being correct

“This doesn't make sense as long as LLMs are non-deterministic.” I think this is a logical error. Non-determinism is orthogonal to probability of being correct. LLMs can remain non-deterministic while being made more and more reliable. I think “guarantee” is not a meaningful standard because a) I don’t think there can be such a thing as a perfect prompt, and b) humans do not meet that standard today.