3 ms·
Try running llama.cpp with 0 temperature and without repetition penalty and you'll sometimes get caught in a loop. Or, if you're okay with a smaller LLM, go he
by dchest 3y ago
Try running llama.cpp with 0 temperature and without repetition penalty and you'll sometimes get caught in a loop.
Or, if you're okay with a smaller LLM, go here, set temperature to zero and enjoy repetition: https://transformer.huggingface.co/doc/distil-gpt2 https://transformer.huggingface.co/doc/distil-gpt2
https://imgur.com/a/hF1Ewk4 https://imgur.com/a/hF1Ewk4