4 ms·
There’s _is_ a degree of randomness in its content generation, you can see it in action by hitting regenerate. It’s a statistical text predictor that iterativel
by schrodinger 3y ago
There’s _is_ a degree of randomness in its content generation, you can see it in action by hitting regenerate. It’s a statistical text predictor that iteratively selects the most like my word after the ones it’s selected so far, but when there are a few good candidates, it’ll choose one at random.
However, the model is static (it’ll present the same candidate word list until retrained), which is what you may have heard. But the way a response is generated introduces the randomness.
Note: I forget the parameter, but if you get the direct API access you can turn off this and get consistent answers.