3 ms·
Odd that they don’t expand on this: In Yandex’s pre-trainings, the implementation of YaFSDP along with other memory optimization strategies resulted in a speed
by az226 2y ago
Odd that they don’t expand on this:
In Yandex’s pre-trainings, the implementation of YaFSDP along with other memory optimization strategies resulted in a speed gain of 45%.