3 ms·
That can handle a 20B model, either in llama.cpp or exLLaMA: https://huggingface.co/models?sort=modified&search=20B https://huggingface.co/models?sort=modified
by brucethemoose2 3y ago
That can handle a 20B model, either in llama.cpp or exLLaMA:
https://huggingface.co/models?sort=modified&search=20B https://huggingface.co/models?sort=modified&search=20B
https://huggingface.co/Kooten/U-Amethyst-20B-3bpw-exl2?not-for-all-audiences=true https://huggingface.co/Kooten/U-Amethyst-20B-3bpw-exl2?not-f...