4 ms·
The "heat" value lets you control the algorithm to choose greater or lower probability outputs. Problem is, once it's already in a good range, it's not very pre
by creatonez 2y ago
The "heat" value lets you control the algorithm to choose greater or lower probability outputs. Problem is, once it's already in a good range, it's not very predictable for increasing the quality of output. Often the hallucinatory results don't actually have a low probability, in which case the same hallucination will come out in multiple attempts. However, it might be interesting to try to make the model directly aware of these numbers by putting it into a post-message evaluation prompt, because currently the token randomization algorithm sits entirely behind the scenes.