2 ms·
It works with current version of GGUF models for llama.cpp - you can find them on huggingface, or you can convert them manually. Only a few download links are
by cztomsik 3y ago
It works with current version of GGUF models for llama.cpp - you can find them on huggingface, or you can convert them manually.
Only a few download links are baked-in at the moment but whatever *.gguf file you put in your Downloads folder should appear in the dropdown.