3 ms·
I noticed that it "hallucinates" in the most direct sense of the word as the description goes on.
by lxe 3y ago
I noticed that it "hallucinates" in the most direct sense of the word as the description goes on.
- ggerganov 3y agoI've found lowering the temperature and disabling the repetition penalty can help [0]. My explanation is that the repetition penalty penalizes the end of sentences and sort of forces the generation to go on instead of stopping. [0] https://old.reddit.com/r/LocalLLaMA/comments/17e855d/llamacpp_server_now_supports_multimodal/k66jpb5/ https://old.reddit.com/r/LocalLLaMA/comments/17e855d/llamacp...