3 ms·
Most LLMs allow you to specify the temperature parameter that governs the randomness and thus the creativity of the responses. For this experiment I used a very
by cmauck10 3y ago
Most LLMs allow you to specify the temperature parameter that governs the randomness and thus the creativity of the responses. For this experiment I used a very low temperature to ensure consistency for a given prompt.
- derwiki 3y agoWe run temp 0 for our prod app and see different results for the same prompt all the time. It’s not every prompt, but the longer ones.