3 ms·
From what I understand top_k is the number of words it generates to pick from, and the top_p is the percentage of the top words it will use as the next word, co
by lxe 4y ago
From what I understand top_k is the number of words it generates to pick from, and the top_p is the percentage of the top words it will use as the next word, correct?
- albystein 4y agoI think it depends on the sampling/decoding method. Also, perhaps you could elaborate more on what you mean by top_p