2 ms·
Isn’t it possible for out of band systems to improve data distribution? You don’t need a fancy model trained on all languages to tell you its training set unde
by brookst 3y ago
Isn’t it possible for out of band systems to improve data distribution?
You don’t need a fancy model trained on all languages to tell you its training set underrepresented Finnish. You just need the training set curators to say “hey there’s no Finnish in the inputs”.
If the goal is high quality models, why be a purist about only using the resulting model to measure deficiencies in the training set?