5 ms·
I'm a complete beginner regarding this stuff, so if I may ask, how would I go about downloading the relevant model (e.g. wizardcoder-python-34b-v1.0.Q4_K_S.gguf
by jfoucher 3y ago
I'm a complete beginner regarding this stuff, so if I may ask, how would I go about downloading the relevant model (e.g. wizardcoder-python-34b-v1.0.Q4_K_S.gguf) I checked on Hugging face but all I got was a bunch of .bin files...
Thanks.
- rpgwaiter 3y agoGoogle the filename + "torrent download"
- npsomaratna 3y agoDo a search on the HuggingFace models page, e.g.: https://huggingface.co/models?sort=trending&search=wizardcoder+gguf https://huggingface.co/models?sort=trending&search=wizardcod...
- jfoucher 3y agoThanks, I managed to convert what I had downloaded with the convert.py script in llama.cpp.