3 ms·
> even early models interpreted the word "crashed" differently in "I crashed my car" and "I crashed my computer" That has nothing to do with semantical underst
by alpaca128 7mo ago
> even early models interpreted the word "crashed" differently in "I crashed my car" and "I crashed my computer"
That has nothing to do with semantical understanding beyond word co-occurrence.
Those two phrases consistently appear in two completely different contexts with different meaning. That's how text embeddings can be created in an unsupervised way in the first place.
- esafak 7mo agoWhat do you mean? Semantics are determined by distribution. https://en.wikipedia.org/wiki/Distributional_semantics https://en.wikipedia.org/wiki/Distributional_semantics