jeffra

9 ms·

1. 1.▲
   by jeffra 7y ago

   We tried to communicate the key ideas in the video released with the blog post. It shows how DeepSpeed and the ZeRO optimizer save memory, and shows exactly what happens during each iteration of training. It is quite different from standard
2. 2.▲
   by jeffra 7y ago

   > Is it getting a lot of internal use already (beyond the example we just heard about)? We have hundreds of internal users of DeepSpeed using it to train production ready models, many of which have been already shipped. > Is it possib
3. 3.▲
   by jeffra 7y ago

   I'm from the DeepSpeed team, we're happy to answer questions if people have them.