3 ms·
> Which local models are you using, that do not output loop garbage at temperature 0? All of them. I make my own frontends using llama-cpp. Quality goes up wit
by otabdeveloper4 1y ago
> Which local models are you using, that do not output loop garbage at temperature 0?
All of them. I make my own frontends using llama-cpp. Quality goes up with temperature 0 and loops are rare.
The temperature setting isn't for improving quality, it's to not break your suspension of disbelief that you're talking to an intelligent entity.
- mdp2021 1y ago> All of them You must be using recent (or just different) models than those I tried. Mine returned garbage easily at temperature 0. (But unfortunately, I cannot try and report from there.) This (LLM behaviour and benchmarking at low or 0 temperature value) should be a topic to investigate.
- otabdeveloper4 1y agoProbably a bug in the code you ran somewhere.