4 ms·
But the only way to unskew it is to remove main language data because there isn't really any to add, no?
by mirekrusin 1y ago
But the only way to unskew it is to remove main language data because there isn't really any to add, no?
- tensor 1y agoYou can also correctly bias your sampling so that when selecting new training instances each language is chosen equally. Generally the diversity of data is good, unless that data is "wrong" which, ironically, is probably most of the internet, but I digress.