3 ms·
Have you played around with any of the Hermes models? they are supposed to be one of the best at non-refusal while keeping sane.
by austinthetaco 6mo ago
Have you played around with any of the Hermes models? they are supposed to be one of the best at non-refusal while keeping sane.
- troad 6mo agoInteresting! Unfortunately, the smallest Hermes 4 model I can see is 14B, which would really strain the limits of my little laptop. The only way I might get acceptable performance would be to run it extremely quantised, but then I probably wouldn't see much improvement over the 9B Qwen.