AbstractGeo

3 ms·

1. 1.▲
   by AbstractGeo 8mo ago

   That's a link from July of 2025, so, definitely not about the current releaase.
2. 2.▲
   by AbstractGeo 8mo ago

   What quantization were you running there, or, was it the official API version?
3. 3.▲
   by AbstractGeo 8mo ago

   IMO, they're worth trying - they don't become completely braindead at Q2 or Q3, if it's a large enough model, apparently. (I've had surprisingly decent experience with Q2 quants of large-enough models. Is it as good as a