3 ms·

> LLMs are anything but consistent Depends on how you're holding them, doesn't it? Set temperature=0.0 and you get very consistent responses, given consistent

by diggan 1y ago

> LLMs are anything but consistent Depends on how you're holding them, doesn't it? Set temperature=0.0 and you get very consistent responses, given consistent requests.

Oras 1y ago
Does the article mention the temperature? I didn't see it.
- diggan 1y ago
  I didn't see that either, you were the one who brought up consistency.
- vessenes 1y ago
  With 38,000 trials you have a pretty good idea of what the sampling space is I’d bet.