At least 48GB of RAM to run with llama.cpp, which now has CUDA GPU Offloading support. The more you can fit on your GPU (in VRAM) the better (for speed), but n

At least 48GB of RAM to run with llama.cpp, which now has CUDA GPU Offloading support. The more you can fit on your GPU (in VRAM) the better (for speed), but no GPU is strictly required.