4 ms·
Literally the first thing I did when I had llama.cpp working was set the temperature to 0 and repeat queries. (but that's mainly because I'm a weird old scient
by dekhn 3y ago
Literally the first thing I did when I had llama.cpp working was set the temperature to 0 and repeat queries.
(but that's mainly because I'm a weird old scientist with lots of experience with nondeterminism in software).
- refulgentis 3y agoI did too, Kmeans broke me a couple years ago: but, never temperature at 0 with long length, and trusted my instinct instead of actual diffs. This is was the first time I actually diffed