3 ms·
Just make the gguf yourself it takes 5 mins and you dont need thebloke
by ekianjo 3y ago
Just make the gguf yourself it takes 5 mins and you dont need thebloke
- fbdab103 3y agoThat was my question. How do I create the gguf?
- onedognight 3y agoUsing the convert.py script in the llama.cpp repo.
- fbdab103 3y agoPerfect, thanks. Don't suppose if you know if the conversion is easily reversible? Some of these models are big, it sucks to carry around the original plus the gguf, but I would hate to be in a situation where the gguf represents a dead end.