3 ms·GPTQ vs. GGML vs. Base Models: Speed and VRAM Test for Vicuna-33B on A100 GPU1 points by tikkun 3y ago