4 ms·
A gaming desktop PC with Nvidia 3060 12GB or better. Upgrade the GPU first if you can afford it, prioritizing VRAM capacity and bandwidth. Nvidia GPU performanc
by modeless 3y ago
A gaming desktop PC with Nvidia 3060 12GB or better. Upgrade the GPU first if you can afford it, prioritizing VRAM capacity and bandwidth. Nvidia GPU performance will blow any CPU including M3 out of the water and the software ecosystem pretty much assumes you are using Nvidia. Laptop GPUs are not equivalent to the desktop ones with the same number so don't be fooled. 8x 3090 (purchased used) is a popular configuration for people who have money and want to run the biggest models, but splitting models between GPUs requires extra work.
Personally I have 1x 4090 because I like gaming too, but it isn't really a big improvement over 3090 for ML unless you have a specific use for FP8, because VRAM capacity and bandwidth are very similar.
- deleted 3y ago[deleted]
- mcmcmc 3y agoNot a dumb question, but maybe dumb to make a whole comment instead of taking two seconds to google it https://www.techspot.com/review/2625-nvidia-rtx-4090-laptop-vs-desktop-gpu/ https://www.techspot.com/review/2625-nvidia-rtx-4090-laptop-...