3 ms·
IDK, I feel it’s quite overpriced, even with the current component prices. I almost sure it’s possible to custom build a machine as powerful as their red v2 wi
by ekropotin 7mo ago
IDK, I feel it’s quite overpriced, even with the current component prices.
I almost sure it’s possible to custom build a machine as powerful as their red v2 within 9k budget. And have a lot of fun along the way.
- lostmsu 7mo agoAMD now has 32 GiB Radeon AI Pro 9700. 4 of these (just under 2k each) would put you at 128 GiB VRAM
- ekropotin 7mo agoVRAM is not everything - GPU cores also matter (a lot) for inference
- lostmsu 7mo ago4x Radeon will have significantly more GPU power than say Mac Studio or DGX Spark.
- cyanydeez 7mo agoinference speed is like monitor Hz; sure, you go from 60 to 120Hz and thats noticeable, but unless your model is AGI, at some point you're just generating more code than you'll ever realistically be able to control, audit and rely on. So, context is probably more $/programming worth than inference speed.