3 ms·
> A one word change to a prompt/spec will produce a drastically different program So in other words, determinism (or lack thereof) is the hard problem!
by virgil_disgr4ce 8mo ago
> A one word change to a prompt/spec will produce a drastically different program
So in other words, determinism (or lack thereof) is the hard problem!
- ddtaylor 8mo agoObviously they are cryptographic hashing functions as they exhibit an avalanche effect!
- ChadNauseam 8mo agoA deterministic program must have the same output for the same input, but determinism does not restrict the outputs for different inputs
- 1718627440 8mo agoI think most people perceive program semantic not only to be defined for the whole program as a whole, but also towards individual subexpressions. If the "LLM compiler" changes the output completely when a single word is added, then it is not deterministic for the subexpressions, that don't contain that addition. Granted that is not the rigorous definition of determinism. Also some existing compilers are non-deterministic with such a definition, namely when "undefined behaviour" would be triggered. That's precisely the problem with UB.