4 ms·
It's because all forms of sampler settings destroy safety/alignment. That's why top_p/top_k are still used and not tfs, min_p, top_n sigma, etc, why temperature
by Der_Einzige 1y ago
It's because all forms of sampler settings destroy safety/alignment. That's why top_p/top_k are still used and not tfs, min_p, top_n sigma, etc, why temperature is locked to 0-2 arbitrary range, etc
Open source is years ahead of these guys on samplers. It's why their models being so good is that much more impressive.
- oblio 1y agoTemperature is the response variation control?
- AH4oFVbPT4f8 1y agoYes, it controls variability or probability of the next token or text to be selected.