3 ms·
They are comparing the speed to execute training to 125K steps, not speed to a given accuracy. In section 4.8 they compare accuracy at the same amount of train
by nl 7y ago
They are comparing the speed to execute training to 125K steps, not speed to a given accuracy.
In section 4.8 they compare accuracy at the same amount of training time for the biggest of each model and show that ALBERT is substantially better.