3 ms·
What's the cheapest way to get the same memory and memory bandwidth as a Mac Studio but also CUDA support?
by chrsw 1y ago
What's the cheapest way to get the same memory and memory bandwidth as a Mac Studio but also CUDA support?
- deleted 1y ago[deleted]
- embedding-shape 1y agoCUDA is only on nvidia GPUs, I guess a RTX Pro 6000 would get you close, two of them are 192GB in total. Vastly increased memory bandwidth too. Maybe two/four of the older A100/A6000 could do the trick too.
- deeviant 1y agoRTX pro does not have NV-link, because money, however. Otherwise, people might not have to drop 40,000 for true inference GPU.
- bigyabai 1y agoSomehow, it is still cheaper to own 10x RTX 3060s than it is to buy a 120gb Mac.
- deleted 1y ago[deleted]
- woodson 1y agoThe Mac will be much smaller and use less power, though.
- bigyabai 1y agoWould almost be a no-brainer if the Mac GPU wasn't a walled garden.
- tuna74 1y agoIs that any different from nVidia?
- bigyabai 1y agoYes? Apple does not document their GPUs or provide any avenue for low-level API design. They cut ties with Khronos, refuse to implement open GPU standards and deliberately funnel developers into a proprietary and non-portable raster API. Nvidia cooperates with Khronos, implements open-source and proprietary APIs simultaneously, documents their GPU hardware, and directly supports community reverse-engineering projects like nouveau and NOVA with their salaried engineers. Pretty much the only proprietary part is CUDA, and Nvidia emphatically supports the CUDA alternatives. Apple doesn't even let you run them.
- embedding-shape 1y agoHow does the introspection/debugging tools look like for Apple/Mac hardware when it comes to GPU programming?
- deleted 1y ago[deleted]