4 ms·
Tokens (parts of words, words, symbols) are represented as vectors. They say there are nokens which are vectors that seem to represent something because they a
by ta988 3y ago
Tokens (parts of words, words, symbols) are represented as vectors.
They say there are nokens which are vectors that seem to represent something because they are organized in that space in a regular manner.
They think those vectors may have something interesting about them because they seem to be somewhat organized and related to each other.
- ta988 3y agoAlso the seem to correspond to things that exist in our world and curiously like things that have existed for a long time, not too recent things.
- JPLeRouzic 3y agoPlease could you point out where these strange definitions are found in the article?
- great_psy 3y agoSearch for the string “children” in the context of children books/stories
- JPLeRouzic 3y agoThanks Great_psy.
- lainga 3y agoLindySpace?
- JPLeRouzic 3y agoThanks for taking care to explain. But aren't all embedded vectors representing something organized?
- ta988 3y ago"This is described, and then the remaining expanse of the embedding space is explored by using simple prompts to elicit definitions for non-token custom embedding vectors (so-called "nokens")" so they make new vectors