3 ms·
I just discovered the other day the hugging face allows you to do exactly this. With the caveat that you enter your hardware manually. But are we really at the
by seemaze 7mo ago
I just discovered the other day the hugging face allows you to do exactly this.
With the caveat that you enter your hardware manually. But are we really at the point yet where people are running local models without knowing what they are running them on..?
- roxolotl 7mo agoThe other nice part of huggingface’s setup is you can add theoretical hardware and search that way too.
- mmmlinux 7mo agoPeople out there are probably vibecoding their username / passwords for websites. Don't under estimate dumb people.
- mongrelion 7mo ago> But are we really at the point yet where people are running local models without knowing what they are running them on..? I can only speak for myself: it can be daunting for a beginner to figure out which model fits your GPU, as the model size in GB doesn't directly translate to your GPU's VRAM capacity. There is value in learning what fits and runs on your system, but that's a different discussion.