4 ms·
200+ GiB of RAM still sounds like a pretty steep hardware requirement.
by qayxc 4y ago
200+ GiB of RAM still sounds like a pretty steep hardware requirement.
- sailingparrot 4y agoIf you have an nvme deepspeed can offload there as a second tier once the RAM is full. 175 GB aggregate on both RAM and nvme is in the realm of home deep learning workstation. As long as you aren’t too fussy about inference speed of course.
- justinlloyd 4y agoOh yeah, that $750 for 256GB of DDR-4 is going to totally break the bank.
- kfrzcode 4y agoDamn I didn't know ram was so cheap
- justinlloyd 4y agoIt only gets expensive if you insist on sourcing it from enterprise vendors. The first 256GB I paid $2,400 for. The second 256GB I paid $1,200 a little over a year later. And the third 256GB I paid $800 about seven months later. I've got a workstation with 768GB DDR4 and I am considering upping that to 1.5TB if the prices on the 256GB sticks will come down.