4 ms·
There's a big difference between sampling from a learned probability distribution and "picks words literally at random". The temperature = 0 examples have zero
by minimaxir 6y ago
There's a big difference between sampling from a learned probability distribution and "picks words literally at random". The temperature = 0 examples have zero sampling by construction, while higher temperatures having a slight sampling.
That said, it doesn't hurt to have multiple attempts (aside from the cost of using GPT-3, ahem).
- skybrian 6y agoI guess I could have left out "literally," but picking words from a learned probability distribution is picking at random. Since words are chosen in order, picking one word differently will likely mean that every word that follows will be different, and this choice between suffixes is not made intelligently. This randomness is there for a reason. Yes, you can turn it off, but then you get loops, which is obviously not intelligent. A bit of randomness makes it less obvious.