4 ms·
> GPT-J at 6B params is too big to load on any consumer GPU (needs ~25GB) You can load that on M1/M2 Macs, which have unified GPU memory up to 128GB.
by erichocean 4y ago
> GPT-J at 6B params is too big to load on any consumer GPU (needs ~25GB)
You can load that on M1/M2 Macs, which have unified GPU memory up to 128GB.