3 ms·
https://youtu.be/re4QqXPmfgs?t=956 https://youtu.be/re4QqXPmfgs?t=956 CS-3 system is built for single node domain scaling to 24 Trillion parameter models. I.e.
by bigcat12345678 2y ago
https://youtu.be/re4QqXPmfgs?t=956 https://youtu.be/re4QqXPmfgs?t=956
CS-3 system is built for single node domain scaling to 24 Trillion parameter models. I.e., they claim you can run the same code without hand-written distributed training code to reach 24 Trillion parameter models.