4 ms·
What kind of specs do I need?
by antibasilisk 4y ago
What kind of specs do I need?
- blagie 4y ago<-- For all of these projects, this is the major question. I just wish it was standard form to include: "This project requires __GB of RAM, and, if running on GPU, __GB of VRAM for the _B parameter model. It will generate output at __ tokens per second on a ___ CPU, and __ tokens per second on a ___ GPU." It's obnoxious as heck as it is right now, since a bunch of things fit, a bunch don't, and there's a lot of overhead to find out.