3 ms·
Consumer nVidia cards are constrained by their RAM which is inconvenient considering the sizes of popular LLMs. An M2 Ultra basically gives you 100+ GB VRAM whi
by blep-arsh 3y ago
Consumer nVidia cards are constrained by their RAM which is inconvenient considering the sizes of popular LLMs. An M2 Ultra basically gives you 100+ GB VRAM which is nice.