3 ms·
This is awesome. Now we also need distributed training of models!
by matheusmoreira 3mo ago
This is awesome. Now we also need distributed training of models!
- woctordho 3mo agoDistributed training is much harder than distributed inference but not impossible. See the recent development of DiLoCo at Nous Research and Prime Intellect.