2 ms·
You can't really run them on a laptop or most consumer hardware though?
by tayo42 3y ago
You can't really run them on a laptop or most consumer hardware though?
- dragonwriter 3y agoYou can run some of the (right combination of smaller and/or quantized) models on consumer laptop/desktop GPUs and even more can be run (if slowly) on CPU with plenty of RAM, but, yeah, beyond a certain point in model capability/performance, you are going to own, or rent, datacenter GPUs.