3 ms·

Heavy quantization

• petesergeant 1y ago
  They claim (or someone on Reddit who claims to be staff claims) that's not accurate: https://www.reddit.com/r/LocalLLaMA/comments/1mk4kt0/comment/n8idqet/ https://www.reddit.com/r/LocalLLaMA/comments/1mk4kt0/comment...