4 ms·
We really need models with lower VRAM requirements to use on consumer grade GPUs. I think there is some good progress in the area (SantaCoder) but it might take
by DethNinja 4y ago
We really need models with lower VRAM requirements to use on consumer grade GPUs.
I think there is some good progress in the area (SantaCoder) but it might take couple of years until someone releases a decent GPT-3 alternative for consumer grade GPUs.