4 ms·
You need to change the temperature to 0 and tune your prompts for automated workflows.
by conception 10mo ago
You need to change the temperature to 0 and tune your prompts for automated workflows.
- balder1991 10mo agoIt doesn’t really solve it as a slight shift in the prompt can have totally unpredictable results anyway. And if your prompt is always exactly the same, you’d just cache it and bypass the LLM anyway. What would really be useful is a very similar prompt should always give a very very similar result.
- tsunamifury 10mo agoThat’s a way different problem my guy.
- jknightco 10mo agoThis doesn't work with the current architecture, because we have to introduce some element of stochastic noise into the generation or else they're not "creatively" generative. Your brain doesn't have this problem because the noise is already present. You, as an actual thinking being, are able to override the noise and say "no, this is false." An LLM doesn't have that capability.
- sheeshe 10mo agoWell that’s because if you look at the structure of the brain there’s a lot more going on than what goes on within an LLM. It’s the same reason why great ideas almost appear to come randomly - something is happening in the background. Underneath the skin.
- dominotw 10mo agohave you tried this? this doesnt work because the way inference runs at big companies. its not just running your query in isolation. maybe it can work if you are running your own inference.