3 ms·
Not to be pedantic but the emergent properties are in the training set, and thus the model and algorithm. There's no magic coming from the universe. What makes
by sirsinsalot 5mo ago
Not to be pedantic but the emergent properties are in the training set, and thus the model and algorithm. There's no magic coming from the universe.
What makes the behavior emergent is that it can't be predicted at training time.
The emergent and unpredictable output is the result of massive vector complexity being encoded.
- coldtea 5mo ago>Not to be pedantic but the emergent properties are in the training set, and thus the model and algorithm. There's no magic coming from the universe. You are either being pedantic or missing the point of emergent however. Yes, it's not some novel unforeseen thing, like a magical Marvel Universe material or some unknown to humanity mode of thinking. Same way when people make something new they still recombine known words, or colors, or physical things in the universe. It is however new capabilities that is not explicitly in the training set and can't be predicted by it. Like teaching something only calculus training materials and it figures out boolean algebra. >The emergent and unpredictable output is the result of massive vector complexity being encoded As opposed to what in humans? God given revelation?
- sirsinsalot 5mo agoMy point was that if training data + encoding/training = model with emergent behaviour The emergent behaviour is in the training data and/or encoding/training. So while I agree it is emergent from the complexity, it isn't some unknown mechanism. Just complexity at scale.
- coldtea 5mo ago>So while I agree it is emergent from the complexity, it isn't some unknown mechanism. Just complexity at scale. So like humans? Like the universe?