3 ms·
After Anthropic, Moonshot is another model provider who restricts tweaking of sampling parameters. I do like the idea of the vendor verifier, though.
by curioussquirrel 6mo ago
After Anthropic, Moonshot is another model provider who restricts tweaking of sampling parameters. I do like the idea of the vendor verifier, though.
- charcircuit 6mo agoIf the post training is done with specific sampling parameters it would make sense to only use the parameters it was trained with.
- curioussquirrel 6mo agoYes, but post training cannot possibly account for all possible use cases. Sane defaults are fine, you can't really do much about sampling parameters in chatbots and coding harnesses anyway. And when making an API call, you have to actively change the parameter in your payload. I don't believe there's any real risk.
- charcircuit 6mo agoThe risk is that people tweak it, potentially on accident, and then think the model is bad instead of understand they are using it wrong. This causes potential reputational damage by exposing the control.
- throwa356262 6mo agoWhat does "restricts tweaking of sampling parameters" mean?
- yorwba 6mo ago"enforcing Temperature=1.0 and TopP=0.95 in Thinking mode, with mandatory validation that thinking content is correctly passed back."