3 ms·
Anything that runs on GPU can be run on CPU, the only question is how much slower it's gonna be.
by drdaeman 3y ago
Anything that runs on GPU can be run on CPU, the only question is how much slower it's gonna be.
- Semaphor 3y agoI know, I have a weak GPU but 64 GB RAM. Using those models works, but it’s more "ask a question, then do something else for a while, while your fans spin up" ;)
- amstan 3y agoI've been running vicunda-13B on a workstation that can be aquired from ebay for about $500. It's slow compared to online services, but probably slightly faster than text to speech would recite its output, so plenty. Falcon 40B is probably too much for it, but apparently there's similar cheap hardware that could work.