4 ms·
> other who are using it must have encountered the same issue > And don't "you're prompting it wrong" me. You can be prompting it expertly and still see the s
by jazzyjackson 3y ago
> other who are using it must have encountered the same issue
> And don't "you're prompting it wrong" me.
You can be prompting it expertly and still see the same errant behavior over and over again, because the models are nondeterministic, they function by taking a different path every time.
Across the distribution of all users and all prompts, there will be a small subset of users who experience miraculous, seemingly intelligent behavior, and there will be a small subset of users who just get junk responses over and over again (the remainder of users get a mixed bag which tells them that the AI may be useful but unreliable).
Personally I think we should object to nondeterministic behavior out of machines, with exceptions for cryptography and physics simulations. It's going to lead to highly un-equal outcomes with no rhyme or reason. Psychologically risky.
- qeternity 3y ago> because the models are nondeterministic The models themselves are not. They are operated this way however to make them more “fun” and “creative”.
- jazzyjackson 3y agoThere's two factors, temperature and seed. You could run the inferencing with a common seed to get the same exchange twice, but you're still using entropy to make choices. If I understand correctly, a temperature of 0 is somewhat equivalent to a markov chain -- choose the result with the highest fit every time. It's not just un-fun and un-creative, it gets stuck in holes and cycles.