I've found lowering the temperature and disabling the repetition penalty can help [0]. My explanation is that the repetition penalty penalizes the end of senten

I've found lowering the temperature and disabling the repetition penalty can help [0]. My explanation is that the repetition penalty penalizes the end of sentences and sort of forces the generation to go on instead of stopping. [0] https://old.reddit.com/r/LocalLLaMA/comments/17e855d/llamacpp_server_now_supports_multimodal/k66jpb5/ https://old.reddit.com/r/LocalLLaMA/comments/17e855d/llamacp...