3 ms·
An LLM is not a mechanical automated system. A deterministic search and replace would be a mechanical automated system. Clearly it wasn't that simple of a pro
by krupan 4mo ago
An LLM is not a mechanical automated system. A deterministic search and replace would be a mechanical automated system. Clearly it wasn't that simple of a problem though.
- qarl 4mo ago> An LLM is not a mechanical automated system. Pretty sure that's exactly what LLMs in coding harnesses are.
- krupan 4mo agoStill not deterministic
- qarl2 4mo agoYou understand that computer programs are deterministic unless someone explicitly injects non-determinism in them, right? Even when they implement LLMs.
- qarl2 4mo agoTo the people downvoting me - I'm sorry, but it's true. I know ChatGPT seems like it's non-deterministic - but that just a user preference. The only real issue is if you have many people on the same server, the GPU contention can be non-deterministic in rare cases. LLMs can be deterministic if you need them to be - it's just that most people prefer the human-like interface.