4 ms·
Does this mean us plebs can run LLMs on gimped VRAM Nvidia lower end cards?
by tharmas 2y ago
Does this mean us plebs can run LLMs on gimped VRAM Nvidia lower end cards?
- swifthesitation 2y agoI don't think so. It seems to just lower the ram needed for the context window. Not for loading the model on the vram.