3 ms·

This can run on 1x 2060S 8 GB

• ComputerGuru 3y ago
  With what degree of quantization?
  • 7moritz7 3y ago
    None, just the default weights using ollama. It's fast too. 13b is where things get slow