3 ms·
How much ram/vram required?
by VadimPR 3y ago
How much ram/vram required?
- MacsHeadroom 3y agoAt least 48GB of RAM to run with llama.cpp, which now has CUDA GPU Offloading support. The more you can fit on your GPU (in VRAM) the better (for speed), but no GPU is strictly required.