3 ms·ZeroDP: Just-in-Time Weight Offloading over NVLink for Data Parallelism1 points by mezark 9mo ago