> I'm wondering whether a Mac Mini M2 Pro or a Mac Studio with M2 Max would still pale in comparison to a Windows based box with an NVIDIA GPU. Mostly it will.

> I'm wondering whether a Mac Mini M2 Pro or a Mac Studio with M2 Max would still pale in comparison to a Windows based box with an NVIDIA GPU. Mostly it will. The one advantage a M2 MAX has is with really large LLM inference with llama.cpp, as you have to compromise quality severely to fit 70B in 24GB of RAM.... but do anything else, especially finetuning, and you want desktop GPUs with as much VRAM as you can get. I just built a 10-liter SFF desktop in a Node 202 with an RTX 3090 for ~2k, and couldn't be more pleased.