4 ms·
> Now I'm wondering if it was trained on (imperfectly) OCRed data too... Or perhaps they inserted typos automatically in the training set as data augmentation.
by krisoft 3y ago
> Now I'm wondering if it was trained on (imperfectly) OCRed data too...
Or perhaps they inserted typos automatically in the training set as data augmentation. Tactics like that is known to increase the roboustness of some models, so why not?
- lrei 3y agoYup totally plausible. Things like word (token) dropout and inserting random uniform noise into embeddings or just edit distance perturbations to the tokens are all well known but still Figure 1 looks extremely impressive.