4 ms·
Sense2Vec is a thing; Spacy has a demo https://demos.explosion.ai/sense2vec/?word=natural%20language%20processing&sense=aut https://demos.explosion.ai/sense2vec
by nl 9y ago
Sense2Vec is a thing; Spacy has a demo https://demos.explosion.ai/sense2vec/?word=natural%20language%20processing&sense=aut https://demos.explosion.ai/sense2vec/?word=natural%20languag...
For many downstream tasks it doesn't seem to improve things though. NLP is hard - lots of things should work but don't because of the sparse training data. Like this slide deck says: most sentences occur only once.
- visarga 9y agoI realized after posting that I was naive. LSTMs are practically word embedding combinators. Training LSTMs should solve the problem of combining words and interpreting them in context.
- Jack000 9y agoI thought Spacy only did part of speech disambiguation rather than sense disambiguation. ie. it would be confused if a word has multiple meanings, all of which are nouns.
- nl 9y agoThis demo uses the Spacy POS tagging to build a word embedding which disambiguates multiple senses. The paper explains it: https://arxiv.org/abs/1511.06388 https://arxiv.org/abs/1511.06388