6 ms·
Min-p is specifically "Don't select tokens less probable than a multiple of the top token's probability" with min_p of 0.1 multiplied by an example top probabil
by Der_Einzige 2mo ago
Min-p is specifically "Don't select tokens less probable than a multiple of the top token's probability" with min_p of 0.1 multiplied by an example top probability of 0.3 being 0.03 as the truncation at that time step.
Source: One of the min_p authors
- suprjami 2mo agoThanks, today I learned!