3 ms·
Yes, they are applied. Here's OpenAI doc which describes how to set various sampling parameters for GPT-3: https://platform.openai.com/docs/api-reference/compl
by dchest 3y ago
Yes, they are applied. Here's OpenAI doc which describes how to set various sampling parameters for GPT-3:
https://platform.openai.com/docs/api-reference/completions/create https://platform.openai.com/docs/api-reference/completions/c...
See presence_penalty and frequency_penalty.
Sampling techniques is one of important arts of LLMs, you'll can find a lot of papers on them.
In general, smaller are more prone to repetition, but you can get caught in it even with larger models.
- dchest 3y agoTo clarify: I meant that in general they are commonly applied, but in this case they weren't as the author confirmed. The repetition, of course, doesn't happen all the time.