3 ms·
Not true, we build novel knowledge all the time. You only have to look at *gestures at everything *.
by abenga 2y ago
Not true, we build novel knowledge all the time. You only have to look at *gestures at everything *.
- triceratops 2y agoRight, sometimes we invent new tokens. It's unclear whether large models can do that yet.
- IshKebab 2y agoWe would not generate novel knowledge if our only interface with the world was a short text based conversation. In other words, I don't think that's a fundamental difference between humans and AI; we just haven't given AI any opportunity to build novel knowledge. Part of that is because it can't really interact with the world yet, in a significant way. Part of it is because nobody has cracked on-line learning. Actually when you give AI the ability to interact with a world, as in RL, it does build novel knowledge.