4 ms·

I expect we'll see some very interesting, very big models following it. I didn't dig too far into the code but the library looks very easy to use and will open

by Tenoke 7y ago

I expect we'll see some very interesting, very big models following it. I didn't dig too far into the code but the library looks very easy to use and will open up a lot of doors for people who have a few or a few thousand GPUs.

ghawkescs 7y ago
I must be missing it, where did you find a link to the code?
- Tenoke 7y ago
  The code for the distributed training library, not the model - https://github.com/microsoft/DeepSpeed/ https://github.com/microsoft/DeepSpeed/