4 ms·

"System requirements" section should really mention what amount of RAM or VRAM is needed for inference.

• awestroke 3y ago
  That depends on which model you use it with. It's "bring your own model"
  • rain1 3y ago
    so list a few known to work models and their requirements
    • seydor 3y ago
      https://old.reddit.com/r/LocalLLaMA/wiki/models https://old.reddit.com/r/LocalLLaMA/wiki/models