I disagree with the “best system in the world for running LLMs” claim. The Mac platform offers high memory bandwidth, but especially with large models you start

I disagree with the “best system in the world for running LLMs” claim. The Mac platform offers high memory bandwidth, but especially with large models you start to quickly run into the fact that the CPU/GPU themselves are very slow compared to discrete GPUs. For models up to 70b parameters, I’d much rather use any PC with a couple of 3090/4090/5090s, and for anything bigger I’d rather 1) use cloud services and pay by the hour, or 2) run a larger Epyc/Xeon system with more GPUs if my use case absolutely requires local/offline support.