5 ms·
If you have an nvme deepspeed can offload there as a second tier once the RAM is full. 175 GB aggregate on both RAM and nvme is in the realm of home deep learn
by sailingparrot 4y ago
If you have an nvme deepspeed can offload there as a second tier once the RAM is full.
175 GB aggregate on both RAM and nvme is in the realm of home deep learning workstation.
As long as you aren’t too fussy about inference speed of course.