2 ms·
It is technically possible to make it fully deterministic if you have a complete control over the model, quantization and sampling processes. The GP probably me
by lifthrasiir 2y ago
It is technically possible to make it fully deterministic if you have a complete control over the model, quantization and sampling processes. The GP probably meant to say that most commercially available LLM services don't usually give such control.
- brookst 2y agoActually you just have to set temperature to zero.