3 ms·
I'm pretty frugal, but my first thought is to get two to run 405B models. Building out 128GB of VRAM isn't easy, and will likely cost twice this.
by ynniv 2y ago
I'm pretty frugal, but my first thought is to get two to run 405B models. Building out 128GB of VRAM isn't easy, and will likely cost twice this.
- rsanek 2y agoYou can get a M4 Max MBP with 128GB for $1k less than two of these single-use devices.
- lolinder 2y agoDon't these devices provide 128GB each? So you'd need to price in two Macs to be a fair comparison to two Digits.
- ynniv 2y agoThese are 128GB each. Also, Nvidias inference speed is much higher than Apple's. I do appreciate that my MBP can run models though!
- layer8 2y agoBut then you have to use macOS.
- ganoushoreilly 2y agoI read the Nvidia units are 250 Tflops vs the M4 Pro 27 Tflops. If they perform as advertised i'm in for two.