3 ms·
That was my question. How do I create the gguf?
by fbdab103 3y ago
That was my question. How do I create the gguf?
- onedognight 3y agoUsing the convert.py script in the llama.cpp repo.
- fbdab103 3y agoPerfect, thanks. Don't suppose if you know if the conversion is easily reversible? Some of these models are big, it sucks to carry around the original plus the gguf, but I would hate to be in a situation where the gguf represents a dead end.