2 ms·
> If you want factual answers from a local model it might help to turn the temperature down. This makes sense. If you interact with a language model and it say
by jrflowers 3y ago
> If you want factual answers from a local model it might help to turn the temperature down.
This makes sense. If you interact with a language model and it says something wrong it is your fault
- astrange 3y agoYou're not "interacting with a language model", you're running a program (llama.cpp) with a sampling algorithm which is not set to maximum factualness by default. It's like how you have to set x264 to the anime tuning or the film tuning depending on what you run it on.