3 ms·MS's parallel DeepSpeed ZeRO effort is also pretty striking considering their investment in OA.by gwern 5y agoMS's parallel DeepSpeed ZeRO effort is also pretty striking considering their investment in OA.