3 ms·
They did all that before: https://arxiv.org/abs/2101.06840 https://arxiv.org/abs/2101.06840, but they could only fit a model with 13B weights on a single V100.
by p1esk 6y ago
They did all that before: https://arxiv.org/abs/2101.06840 https://arxiv.org/abs/2101.06840, but they could only fit a model with 13B weights on a single V100.