3 ms·
GPT's output is by default somewhat random. If you ask the same exact question several times, you'll potentially get several different answers. Each successiv
by williamstein 4y ago
GPT's output is by default somewhat random. If you ask the same exact question several times, you'll potentially get several different answers. Each successive word in the output is chosen from a distribution of possibilities -- that distribution is fixed, but that actual sample chosen from the distribution is not fixed. See, e.g., https://platform.openai.com/docs/api-reference/completions/create#completions/create-temperature https://platform.openai.com/docs/api-reference/completions/c...
- vorticalbox 4y agoWhen using the openAi end points you can set the temperature, k_top etc. That will allow you to tone down the randomness. Passing a temperature of 0 would mean same input always has the same output.