4 ms·
"Similar" is an inherently semantic property.
by FeepingCreature 5y ago
"Similar" is an inherently semantic property.
- JonChesterfield 5y agoWords with the same length are similar to one another but not well correlated semantically. E.g. bog vs dog.
- tsimionescu 5y agoWould you say that something like string.GetSimilarity(string), which tells you by what number of characters two strings differ, is interpreting the text? Basically what GPT-3 does is to find a string X of a particular length such that it maximizes concat(userInput, X).GetSimilarity(someStringInTrainingSet). Edit: to be clear, I'm not suggesting it's looking up the training set at runtime, X.GetSimilarity(someStringInTrainingSet) is basically what got baked in during training.
- FeepingCreature 5y agoThat is not what GPT does.