4 ms·
I am duper frustrated that AMD doesn't make a "ML Edition" 48GB 7900. They dont have much to lose, so why not throw down the gauntlet. Doubly so for Intel. The
by brucethemoose2 3y ago
I am duper frustrated that AMD doesn't make a "ML Edition" 48GB 7900. They dont have much to lose, so why not throw down the gauntlet.
Doubly so for Intel. They literally have no pro market to lose with a 32GB A770, and everything to gain from momentum for their stack.
- slavik81 3y agoThe Radeon Pro W7900 is 48 GB. https://www.amd.com/en/products/professional-graphics/amd-radeon-pro-w7900 https://www.amd.com/en/products/professional-graphics/amd-ra... The W7900 is officially supported by ROCm on Windows. On Linux, the W7900 is enabled, though not officially supported.
- brucethemoose2 3y agoFor ~$4000. Thats not A/H100 terrible, but its still out of reach for many nonprofessional ML users/tinkerers.
- woodson 3y agoIt's roughly on par with NVIDIA RTX A6000, which also has 48GB VRAM.
- brucethemoose2 3y ago...Yes, and thats the problem. As a reminder, the A6000 is basically a double RAM 3090 TI, a 2020 GPU going for $4K. Nvidia is Nvidia as needs to preserve their pro tier stratification. But AMD has less to lose, and Intel has nothing to lose by pricing them more like gaming cards.
- kimixa 3y agoProbably because they want people to buy the W/MI series cards instead. Though looking around you can get an MI60 on ebay for $500, seems really good for 32gb and still seems to be supported by rocm (as it's just an MI50 with more hbm). Looks to be the cheapest way of getting a GPU with that region of memory support, though things like FP16 speed and BF support suffers compared to later generations. Though from what I've seen most "home" ML tasks are often memory limited pretty hard before ALU limitations kick in. And no idea if a home user would be able to use the IF links either for helping multi-gpu either.