4 ms·
Ah, yes I may have mis-remembered or misunderstood when looking at the training data and model definition, it would have been about a decade ago now. Or perhap
by kevindamm 3y ago
Ah, yes I may have mis-remembered or misunderstood when looking at the training data and model definition, it would have been about a decade ago now. Or perhaps I was thinking of an unrelated experiment to use chosen analogies during training but yeah that isn't part of the original paper.
The training process from the original Mikolov et al. paper only uses the analogy examples (questions-words.txt and questions-phrases.txt) to measure accuracy after training:
https://github.com/tmikolov/word2vec/blob/20c129af10659f7c50e86e3be406df663beff438/demo-train-big-model-v1.sh#L98 https://github.com/tmikolov/word2vec/blob/20c129af10659f7c50...