4 ms·
> That there, though, also shows why AI-generated text is something completely different; calculators are deterministic devices: if you calculate 4,839 + 3,948
by TacticalCoder 4y ago
> That there, though, also shows why AI-generated text is something completely different; calculators are deterministic devices: if you calculate 4,839 + 3,948 - 45 you get 8,742, every time.
ChatGPT is just a program. Given the exact same input and seed, its result is going to be 100% deterministic too. It's just that it's going to get the same wrong result in a deterministic way. Determinism may be hidden away from end user (I don't know about that) but there's just no way around it: it's a program and give the same inputs, it's fully deterministic.
And if the user / discussion trains it with more input, it's possible to replay these inputs, in the same order, and get the exact same answer from the AI.
StableDiffusion allows users to use it in a 100% deterministic way.
ChatGPT may or may not (I really just don't know) but that'd just be a detail / choice made by OpenAI. I can try it now and have ChatGPT tell me 1309849874 divided by 2 is 24891, being several orders of magnitude of. And then try it again and it give something else. But that's just because I got connected to another instance, using other seeds or a slightly different model.
At some point there's going to be a free model and it's going to be fully deterministic if the user wants it to be.
It's just code running on data. There's no magic.
- sublinear 4y agoDoes anyone really want a deterministic ChatGPT though? Relying on an incorrect model frozen in time seems worse than relying on an incorrect model that is continuously improved. Expert systems of the past were deterministic in that the answers were computed from assumed facts and the logic could be queried. That's fundamentally different from how this works.