3 ms·
That's been done already. See DeepSpeed ZeRO NVMe offload: https://arxiv.org/abs/2101.06840 https://arxiv.org/abs/2101.06840
by treprinum 3y ago
That's been done already. See DeepSpeed ZeRO NVMe offload:
https://arxiv.org/abs/2101.06840 https://arxiv.org/abs/2101.06840