2 ms·
Can someone explain this? They just reduce the English text during pretraining to balance it out? Shouldn't that harm every other benchmark though?
by andai 2y ago
Can someone explain this? They just reduce the English text during pretraining to balance it out? Shouldn't that harm every other benchmark though?