3 ms·
Well, this might be unpopular but for the 2000$ price point it may be the macOS ecosystem. The most important part to run LLMs might be the VRAM-size. Since mo
by sandreas 2y ago
Well, this might be unpopular but for the 2000$ price point it may be the macOS ecosystem.
The most important part to run LLMs might be the VRAM-size. Since modern Macs use unified memory you simplified get RAM=VRAM, so a 64GB MacBook Pro might outperform an NVidia 4090 in LLMs.
However the specialized cards from nvidia have more VRAM and are generally faster.
The LLM of your choice should fit into vram, so if you only need 21gb, one 4090 will do the job