3 ms·

Quantized 7B LLMs should work fine on your machine, though maybe you’re talking about speed?

• yieldcrv 3y ago
  7B works fine