4 ms·
You seem confused. Please feel free to read my post near the top of this very chain of comments, where I specifically compare a Mac Studio to a machine with 6 t
by angoragoats 2y ago
You seem confused. Please feel free to read my post near the top of this very chain of comments, where I specifically compare a Mac Studio to a machine with 6 to 8 Nvidia GPUs. That was the discussion “from the start.”
> In any case how are you going to fit 50+GB in two (theoretically 24+24 GB) Nvidia cards
No one was talking about only two cards.
- Y-bar 2y ago> Mac Studio to a machine with 6 to 8 Nvidia GPUs. That post read like a joke comparison and still does. Can you elaborate how it is relevant?
- angoragoats 2y agoWhat seems like a joke about it? And relevant to what, exactly? The parent of my initial comment in this thread said: "For inference, Apple chips are great due to a high memory bandwidth... It's a cost effective option if you need a lot of memory plus a high bandwidth." My post was attempting to explain at a high level how 1) Apple SoCs do not really have high memory bandwidth compared to a cluster of GPUs, and 2) you can actually build that cluster of GPUs for the same cost or cheaper than a loaded Mac Studio, and it will drastically outperform the Mac. If you want specifics on how to build such a GPU cluster, you can search for "ROMED8-2T 3090" for some examples. I hope this helps.