3 ms·
Regardless of the marketing material, LLMs are still just using probabilities to guess what the next token is.
by ru552 5mo ago
Regardless of the marketing material, LLMs are still just using probabilities to guess what the next token is.
- anuramat 5mo agoyou think it should be deterministic?
- bigfishrunning 5mo agoIf LLMs were configured to be deterministic, instead of the current "small amount of randomness to provide the illusion of a thinking machine", they would be much more useful in exchange for being less exciting to laypeople. In other words, scam.
- anuramat 5mo agoyou know you can set the temperature to zero and get exactly that, right?