3 ms·
> AI is not detecting any kind of conceptual association. It is merely recording co-occurance. Can you explain the famous example of “king - man + woman = quee
by bitcurious 5y ago
> AI is not detecting any kind of conceptual association. It is merely recording co-occurance.
Can you explain the famous example of “king - man + woman = queen” through this perspective? Naively it does seem to extend beyond statistical representation as it seems some semantic association is preserved through the mapping of language onto a vector space.
- mjburgess 5y agoWell, it's essentially a coincidence mixed in with a bit of superstition. K - M has no semantics, its more like something you'd find in a teen magazine. "K - M" means as much, "Prince" or "Jesus Christ" or any of a number of words. The type of association underlying word vectors is just expecting to co-occur. So there are many cases we can enumerate where our expectation that Q occurs is modulated by M occurring. So if M hasn't occurred in some text, we expect Q rather than K. (Equally, in biblical literature, we might expect JC to occur; and in disney films, "prince"). And many of these famous examples are just tricks. Very nearly all of the industry sells this technology based on a few cases which happen to turn out "as a lay audience would expect", and neglect to include the many many cases where they do not. And to be clear, we should not expect "K - M" to be "Q" in anything other than a basically statistical sense, relative to some texts. "King - Man" isn't a semantic operation.