4 ms·
A whole article that ultimately boils down to "the majority of normies are using LLM systems with low temperature settings". Literally just set the damn temper
by Der_Einzige 3y ago
A whole article that ultimately boils down to "the majority of normies are using LLM systems with low temperature settings".
Literally just set the damn temperature higher and allow for sampling from deeper down in the distribution (so relax top_p, top_k or equiv parameters) and suddenly you get creativity, and also more unhinged behavior.
- htrp 3y agochatgpt doesn't expose temp settings which is what most ppl use
- baobabKoodaa 3y agoWait whaat? You mean most people don't run dockerized Mixtral-Dolphin-4B-88X instances on a Kubernetes deployment in a GPU farm they built in their cellar?
- red-iron-pine 3y agowait, you're telling me I could just run that in my basement?