12 ms·
Could the model or algorithm be changed to make it deterministic somehow? It could help a lot if there were reproduceable outputs from deterministic baked-in si
by logicallee 2mo ago
Could the model or algorithm be changed to make it deterministic somehow? It could help a lot if there were reproduceable outputs from deterministic baked-in silicon.
- Tuna-Fish 2mo agoYou can make any LLM deterministic by dropping the temperature hyperparameter to zero. This will generally make them suck, though, a little bit of randomness is necessary for proper function.
- fwip 2mo agoYou can also use a fixed seed for your prng. A hash of the input text (up to the current turn) should do.