http://www.jmlr.org/papers/volume3/bengio03a/bengio03a.pdf http://www.jmlr.org/papers/volume3/bengio03a/bengio03a.pdf Bengio has a paper in 2003 that describes

http://www.jmlr.org/papers/volume3/bengio03a/bengio03a.pdf http://www.jmlr.org/papers/volume3/bengio03a/bengio03a.pdf Bengio has a paper in 2003 that describes almost the same idea as word2vec (CBOW model to be exact).