Repetition penalty is a matter of, generate a token, then multiply that logit by the penalty. (If the logit is negative, divide instead of multiply.) https://g

Repetition penalty is a matter of, generate a token, then multiply that logit by the penalty. (If the logit is negative, divide instead of multiply.) https://github.com/shawwn/llama https://github.com/shawwn/llama has an implementation (check the commit history).