4 ms·
macbook pros are by far the best device you can get for running local llms. first of all nvidia gpu's have extremely limited vram relative to the 100+gb afforde
by coconut08 2y ago
macbook pros are by far the best device you can get for running local llms. first of all nvidia gpu's have extremely limited vram relative to the 100+gb afforded to macbook pros. second you cant take an llm server on the subway with you.
until you can show me small nvidia laptop with 128gb of vram and 20 hours of battery life, i'll keep using my macbook.