> Isn't there any value in having variance in the generated responses? Sure, which is why the technique is used. But that doesn't mean "random" is a useful des

> Isn't there any value in having variance in the generated responses? Sure, which is why the technique is used. But that doesn't mean "random" is a useful descriptor. I, as a human, try to add variance to my responses as well - does that mean my mind is "random"? That's why my point is that there is no inherent randomness in the process. We use a bit of randomness to make it subjectively better, but it's fundamentally not random.