4 ms·
Hugging Face has such a large repository of models! Curious how folks have been exploring HF models to date, and if this notebook-style environment to try out m
by saqadri 3y ago
Hugging Face has such a large repository of models! Curious how folks have been exploring HF models to date, and if this notebook-style environment to try out many models in one place would help?
- tapland 3y agoI've tried running some using https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui on my arch box with an AMD gpu and it worked well and was really handy, until I tried yesterday and I get some python error no matter what I do, with the same environment as before and with a new one \o/ There doesn't seem to be an obvious easy way to run them with GPU support.
- PeterisP 3y agoIn current ML environment, there's no single thing as "GPU support" as nVidia and AMD are two very different (and unequal) worlds - if you want things to work on AMD, then you should look for things which are explicitly labeled as AMD-compatible, because the default state of "has GPU support" is slang for "works on CUDA, but also might work on AMD if stars are right".
- saqadri 3y agoAh interesting! What models were you running inference on (assuming locally)?
- tapland 3y agoI just ran the default one in the readme. My partner ran a few others from huggingface, but I don't know which.