3 ms·

sillysaurusx made some posts about tweaks that greatly improved output for him. Maybe they would help you: """ Fixed the llama sampler. After turning off top_

by dmm 4y ago

sillysaurusx made some posts about tweaks that greatly improved output for him. Maybe they would help you: """ Fixed the llama sampler. After turning off top_p, adding top_k 40, setting temp to 0.7, and adding a repetition penalty of 1/0.85, llama 7B is looking nice. """ https://twitter.com/theshawwn/status/1632569215348531201?cxt=HHwWgoCzgafDhqgtAAAA https://twitter.com/theshawwn/status/1632569215348531201?cxt... https://twitter.com/theshawwn/status/1633456289639542789?cxt=HHwWisC9wen1mastAAAA https://twitter.com/theshawwn/status/1633456289639542789?cxt...

Szpadel 4y ago
for reference I tried or here: https://lite.koboldai.net/ https://lite.koboldai.net/ with chat mode, and parameters: temp 0.62, top_p 0.9, repetition penalty 1.08 is free to try, but then you have to wait in queue, therefore I had to wait 10min per response and I didn't had patience to test it further