3 ms·
A deterministic LLM is possible. Would you trust it?
by chrisjj 2mo ago
A deterministic LLM is possible. Would you trust it?
- xdavidliu 2mo agothey probably mean deterministic in the sense of traditional computer programs consisting of if-else decision points and ordinary cpu logic, as opposed to numerical models (which can of course be deterministic too, as you pointed out)
- TonyAlicea10 2mo agoI mean in the traditional software sense. We trust autopilots to fly planes. Would you get on a plane flown by an LLM?
- chrisjj 2mo agoThen I think I'd rephrase you: There's a reason we trust trusted systems. :) Even their fans agree, LLMs are inherently unreliable. The fact some people trust them regardless is due to a deep flaw in human psychology that I believe has not been significantly exploited by any previous tech. There will be tears.
- TonyAlicea10 2mo agoI think two things contribute to the trust in LLMs: 1. Decades of generally reliable systems (I trust my calculator because it always says 1+1=2) has trained people to believe what computers say. 2. LLMs "speak" with great confidence, which has, as you say, a psychological effect.
- chrisjj 2mo agoI agree.
- eikenberry 2mo agoThere are 2 levels of determinism that matter here IMO. Level 1, given the same input you get the same output. Level 2, you know what to change on the input to get a specific change on the output. LLMs are currently capable of level 1, but not capable of level 2. Trust follows what is actually deterministic.
- chrisjj 2mo agoTrust should, but instead is being gulled by those incapable LLMs. And I don't see that changing, given the typical human's seemingly unlimited vulnerability to this con.