4 ms·
Generally the reason behind adding randomness to machine learning is avoiding "local minima" in the search space of the optimization function(s) used for traini
by seanhunter 3y ago
Generally the reason behind adding randomness to machine learning is avoiding "local minima" in the search space of the optimization function(s) used for training the model. If your training produces a very smooth descent to an optimum it can lead to the model converging on a solution that is not globally the best. Adding some randomness helps to avoid this.
Specifically for GPT models, the temperature parameter is used to get outputs wihch are a bit more "creative" and less deterministic. https://help.promptitude.io/en/ai-providers/gpt-temperature https://help.promptitude.io/en/ai-providers/gpt-temperature