2 ms·
> LLMs can be deterministic if you set the temp to zero. At which point, you the major benefit statistical models like of LLMs… A lot of performance is lost i
by dartos 2y ago
> LLMs can be deterministic if you set the temp to zero.
At which point, you the major benefit statistical models like of LLMs…
A lot of performance is lost if you fix the sampling step like that as well.
That’s why nobody does it…