3 ms·
>> One thing that I think will be challenging is that language has observer depending meaning. The idea with word embeddings is that they provide a context for
by YeGoblynQueenne 11y ago
>> One thing that I think will be challenging is that language has observer depending meaning.
The idea with word embeddings is that they provide a context for words, which informs their meaning.
It goes back to Zellig Harris and the observation that "constituents of the same type can be replaced by each other" [1], or in other words: words that occur in the same context have the same meaning.
[1] Zellig Harris. 1951. Methods in Structural Linguistics.
- kajecounterhack 11y agoIf anyone is interested in embeddings, they are really cool and here is a relevant paper: https://cs.stanford.edu/~quocle/paragraph_vector.pdf https://cs.stanford.edu/~quocle/paragraph_vector.pdf (This is to say there is such a thing as an unsupervised method for creating features that encode meaning, and it's being used today for various tasks :] )
- zardo 11y agoThe meaning to the reader is not encoded. Maybe something like book to book-review or book to cliff notes mappings could try to capture that.