4 ms·
It's technically deterministic, but it feels nondeterministic in chatbots since tokens are randomly sampled (temp > 0) and input is varied. Using the right prom
by potatoman22 10mo ago
It's technically deterministic, but it feels nondeterministic in chatbots since tokens are randomly sampled (temp > 0) and input is varied. Using the right prompt makes the model perform better on average, so it's not completely dumb.
I like task vectors and soft prompts because I think they show how prompt engineering is cool and useful.
https://arxiv.org/pdf/2310.15916 https://arxiv.org/pdf/2310.15916
https://huggingface.co/docs/peft/conceptual_guides/prompting https://huggingface.co/docs/peft/conceptual_guides/prompting
- BoiledCabbage 10mo ago> It's technically deterministic, but it feels nondeterministic in chatbots since tokens are randomly sampled Are you not aware the random sampling makes something non-deterministic?
- rTX5CMRXIfFG 10mo agoI don’t believe that when he wrote that, he was using his own intelligence
- potatoman22 10mo agoAt least I'm adding to the discussion.
- rTX5CMRXIfFG 10mo agoPeople who disagree with you add to the discussion too
- potatoman22 10mo agoI'm saying LLMs are deterministic and because of that, prompt engineering can be effective. You knew what I was trying to say, but chose to ignore it. You should follow the HN Guidelines. I'm trying to have a discussion, not a snarkfest. > Be kind. Don't be snarky. Converse curiously; don't cross-examine. Edit out swipes. > Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize. Assume good faith.