2 ms·
I just had a completely identical, character-by-character conversation with it. Shouldn't there be at least a very little bit of randomness?
by golergka 4y ago
I just had a completely identical, character-by-character conversation with it.
Shouldn't there be at least a very little bit of randomness?
- deleted 4y ago[deleted]
- gpm 4y agoPer the code linked there is temperature (optional, default=0.1): Controls the randomness of the generated text. Higher values produce more diverse results, while lower values produce more deterministic results. top_p (optional, default=0.75): The cumulative probability threshold for token sampling. The model will only consider tokens whose cumulative probability is below this threshold. top_k (optional, default=40): The number of top tokens to consider when sampling. The model will only consider the top_k highest-probability tokens. Potentially they set temperature to 0? Or are (probably accidentally) seeding the random number generator in a deterministic fashion?