4 ms·

Chatgpt is a stochastic word correlation machine, nothing more. It does not understand the meaning of the words it uses, and in fact wouldn't even need a dictio

Chatgpt is a stochastic word correlation machine, nothing more. It does not understand the meaning of the words it uses, and in fact wouldn't even need a dictionary definition to function. Hypothetically, we could give chatgpt an alien language dataset of sufficient size and it would hallucinate answers in that language, which neither it nor anybody else would be able understand. This isn't AI, not in the slightest. It has no understanding. It doesn't create sentences in an attempt to communicate an idea or concept, as humans do. It's a robot hallucinating word correlations. It has no idea what it's saying, or why. That's not AI overlord stuff.

ux-app 4y ago
>Chatgpt is a stochastic word correlation machine it seems humans might be too...? my son is 4. when he was 2, I told him I love him. he clearly did not understand the concept or reciprocate. I reinforced the word with actions that felt good: hugs, warmth, removing negative experience/emotion etc. Isn't that just associating words which align with certain "good inputs". my son is 4 now and he gets it more, but still doesn't have a fully fleshed out understanding of the concept of "love" yet. He'll need to layer more language linked with experience to get a better "understanding". LLMs have the language part, it seems that we'll link that with physical input/output + a reward system and ..... ? Intelligence/consciousness will emerge, maybe? "but they don't _really_ feel" - ¯\_(ツ)_/¯ what does that even mean? if it walks like a duck and quacks like a duck...
- TeMPOraL 4y ago
  > Intelligence/consciousness will emerge, maybe? Extending that: LLM latent spaces are now some 100 000+ dimensional vector spaces. There's a lot of semantic associations you can pack in there by positioning tokens in such space. At this point, I'm increasingly convinced that, with sufficiently high-dimensional latent space, adjacency search is thinking. I also think GPT-4 is already close to be effectively a thinking entity, and it's more limited by lack of "inner loop" and small context window than by the latent space size. Also, my kids are ~4 and ~2. At times they both remind me of ChatGPT. In particular, I've recently realized that some of their "failure modes" in thinking/reacting, which I could never describe in a short way, seem to perfectly fit the idea of "too small context window".
barking_biscuit 4y ago
>It's a robot hallucinating word correlations. It has no idea what it's saying, or why. That's not AI overlord stuff. All that matters is economic and political impact. Definitions are irrelevant.
nuancebydefault 3y ago
You say it has no understanding. So people can communicate idea's/concepts while chatgpt can't. What if... what we think are idea's or concepts, are in fact prompts recited from memory, which were planted/trained during our growing up? In fact I'm pretty sure our consciousness stems from or is memory feeding a (bigger and more advanced) stochastic correlation machine. That chatgpt can only do this with words, does not mean the same technique cannot be used for other data, such as neural sensors or actuators. Chatgpt could be trained with alien datasets and act accordingly. Humans can be trained with alien datasets. See the convergence?
- pixl97 3y ago
  I'm pretty sure LLMs can be used on anything considered a language, including things we as humans wouldn't consider language. Sam Harris was recently talking about using an LLM processing wireless signals to identify where humans were standing in a room. I've not looked up the paper on this, but from everything I understand about this the generalized applican can apply to vast ranges of data.

ux-app 4y ago

>Chatgpt is a stochastic word correlation machine it seems humans might be too...? my son is 4. when he was 2, I told him I love him. he clearly did not understand the concept or reciprocate. I reinforced the word with actions that felt good: hugs, warmth, removing negative experience/emotion etc. Isn't that just associating words which align with certain "good inputs". my son is 4 now and he gets it more, but still doesn't have a fully fleshed out understanding of the concept of "love" yet. He'll need to layer more language linked with experience to get a better "understanding". LLMs have the language part, it seems that we'll link that with physical input/output + a reward system and ..... ? Intelligence/consciousness will emerge, maybe? "but they don't _really_ feel" - ¯\_(ツ)_/¯ what does that even mean? if it walks like a duck and quacks like a duck...

TeMPOraL 4y ago
> Intelligence/consciousness will emerge, maybe? Extending that: LLM latent spaces are now some 100 000+ dimensional vector spaces. There's a lot of semantic associations you can pack in there by positioning tokens in such space. At this point, I'm increasingly convinced that, with sufficiently high-dimensional latent space, adjacency search is thinking. I also think GPT-4 is already close to be effectively a thinking entity, and it's more limited by lack of "inner loop" and small context window than by the latent space size. Also, my kids are ~4 and ~2. At times they both remind me of ChatGPT. In particular, I've recently realized that some of their "failure modes" in thinking/reacting, which I could never describe in a short way, seem to perfectly fit the idea of "too small context window".

barking_biscuit 4y ago

>It's a robot hallucinating word correlations. It has no idea what it's saying, or why. That's not AI overlord stuff. All that matters is economic and political impact. Definitions are irrelevant.

nuancebydefault 3y ago

You say it has no understanding. So people can communicate idea's/concepts while chatgpt can't. What if... what we think are idea's or concepts, are in fact prompts recited from memory, which were planted/trained during our growing up? In fact I'm pretty sure our consciousness stems from or is memory feeding a (bigger and more advanced) stochastic correlation machine. That chatgpt can only do this with words, does not mean the same technique cannot be used for other data, such as neural sensors or actuators. Chatgpt could be trained with alien datasets and act accordingly. Humans can be trained with alien datasets. See the convergence?

pixl97 3y ago
I'm pretty sure LLMs can be used on anything considered a language, including things we as humans wouldn't consider language. Sam Harris was recently talking about using an LLM processing wireless signals to identify where humans were standing in a room. I've not looked up the paper on this, but from everything I understand about this the generalized applican can apply to vast ranges of data.