3 ms·
> A lot of the content on HN/Reddit/forums is of low quality grammatically and often written by non-native English speakers (such as myself). Corrected: > A l
by babuskov 10y ago
> A lot of the content on HN/Reddit/forums is of low quality grammatically and often written by non-native English speakers (such as myself).
Corrected:
> A lot of the content on the HN/Reddit/forums is of the quality grammatically and non-native written by written English speakers (such myself). as UNK
Yeah. It's got a long way to go. No idea where "as UNK" came from.
- pilooch 10y agoUNK usually comes from the final sampling step: the distribution of words contains a special token UNK to represent all words with insufficient statistics in the training corpus.
- pizza 10y agoIt's like the equivalent of NaN; what you put when you don't know what should be there. coincidentally, the op corrected this as: It's like the equivalent of NaN