3 ms·
Yes. The ceiling is the floor. The limitation is inherent in the core design. There is no overcoming. This is not a hurdle or a wall. It's a design flaw. Is i
by thomastjeffery 4y ago
Yes. The ceiling is the floor.
The limitation is inherent in the core design. There is no overcoming. This is not a hurdle or a wall. It's a design flaw.
Is it totally useless to everyone? No. Not completely. It's like a coherent search engine: a way to find data that is close to other data. But "close to" in this case is only "semantically", and never "logically", so that's that.
Is it going to get any less useless than it is? Only slightly. "It" will never get better. The only better version of "it" is a completely new ground-up redesign that doesn't resemble "it" at all.
- fasterik 4y agoModern neural network architectures are Turing complete [1]. So I don't see any argument for a limit in principle unless you are arguing that a Turing machine can't achieve language understanding. If that's what you're saying, then I wonder who is espousing mysticism here. [1] https://arxiv.org/abs/1901.03429 https://arxiv.org/abs/1901.03429
- thomastjeffery 4y agoAre you forgetting the distinction between a program and a computer? Language understanding doesn't magically spawn itself as a process on your computer! Someone has to write that program first. And that's my point. ChatGPT transforms language, but it does not understand it. For that, we will need a different kind of program.
- fasterik 4y agoLanguage understanding doesn't magically spawn itself as a process on your computer! Someone has to write that program first. Do you think it's impossible for such a program to emerge as weights in a Turing complete neural network architecture?