5 ms·
Isn't this just ignoring all the lessons we learned from pretraining large models? Seems like a different flavor of the bitter lesson.
by eldenring 3y ago
Isn't this just ignoring all the lessons we learned from pretraining large models? Seems like a different flavor of the bitter lesson.