3 ms·
You can fix looping with proper repetition penalties. Turn on the one called “DRY” that PeW invented and got merged into llama cpp
by Der_Einzige 4mo ago
You can fix looping with proper repetition penalties. Turn on the one called “DRY” that PeW invented and got merged into llama cpp
- npodbielski 4mo agoI added repetition penalty of two. I do not know. Maybe it is not applied correctly somehow by llama swap, that I am using, but I do not consider it that much of a nuisance to so I did not tried to fix it yet. Do you have this DRY docs?