3 ms·
> The only real difference between what you are describing and GPT-3 is that your dataset from which you draw all your opinions about the world is unique and co
by anyonecancode 4y ago
> The only real difference between what you are describing and GPT-3 is that your dataset from which you draw all your opinions about the world is unique and comes from the sensory input you had experienced in your life, stored directly in memory. Whereas GPT-3's dataset comes from slices of many other peoples' sensory experiences, stored in language.
So is this debate partially just another way of asking if language is the same as reality? The difference between "things I've experienced" vs "stored in languages" seems... not trivial to me? Both in that I think the way biological memory works is non-trivially different from word tokens stored in computer memory, and also in that I think there's more to having experienced something than it just being stored in biological memory (or maybe that biological memory is more than just "memories", but is encoded throughout the body overall -- a scar is a type of memory of an injury, for instance, connected to but still different from my "memory" of having received it).
- skjoldr 4y agoYes, it is partially about whether human models of reality (encoded in the relationship between word tokens) can approximate reality itself to such a degree where the quantity of ingested information can substitute for its quality. Human brains and senses are obviously qualitatively different, but AIs have the advantage of unimaginably massive bandwidth of incoming textual information. Now, one of the hardest difficulties here is setting up the goal structure for this kind of AI. Just filling in the blanks is obviously insufficient.