4 ms·

How can their internal representation represent "concepts" when the training data is all words? There's no possible experience of the world there. No input othe

How can their internal representation represent "concepts" when the training data is all words? There's no possible experience of the world there. No input other than a bunch of imperfect labels we created for stuff.

sebastiennight 3mo ago
This is a wild argument. If I use the word "semantic", do you have a concept of what it means? If so, can you please share which of your senses have shaped the world experience that inform this concept? What have you smelled, tasted, caressed, that informed this concept outside of words? If I make up the word "polysemantic", do you need to recall a personal experience of polyamory to understand it, or could you possibly use your concept of "poly" and your concept of "semantic" to figure out this new concept?
- sublinear 3mo ago
  Yes, but are you claiming that LLMs perform more specific acts of cognition beyond organizing information?
  - sebastiennight 3mo ago
    I'm puzzled by this question. Does the material universe perform any other acts than organizing information? I feel like you're trying to make me argue a position I'm not defending here.
  - robotresearcher 3mo ago
    What does 'organizing information' exclude?
- rsoto2 3mo ago
  Yes. When someone is teaching you language as a baby you have eyes and ears and 100 million nerve endings and constant "training" to understand language. You cannot understand the word "semantics" as a human without this crucial "training" step. My god you people will pull out the most bs metaphors to justify being in awe(and debt) to a software program.
visarga 3mo ago
> There's no possible experience of the world there. No input other than a bunch of imperfect labels we created for stuff. The brain too sits locked inside a bone box and only gets a bundle of unlabeled nerves connecting it to the outside. How can the brain could possibly experience anything, it only sees patters and patterns of patterns never the real thing?
- sebastiennight 3mo ago
  > a bundle of unlabeled nerves connecting it to the outside As a species, we do need to up our cable management skills. We're likely not getting augmented humans until we get there.
- rsoto2 3mo ago
  a bone box.. with eyes and 100 million nerve endings to experience the world...

sebastiennight 3mo ago

This is a wild argument. If I use the word "semantic", do you have a concept of what it means? If so, can you please share which of your senses have shaped the world experience that inform this concept? What have you smelled, tasted, caressed, that informed this concept outside of words? If I make up the word "polysemantic", do you need to recall a personal experience of polyamory to understand it, or could you possibly use your concept of "poly" and your concept of "semantic" to figure out this new concept?

sublinear 3mo ago
Yes, but are you claiming that LLMs perform more specific acts of cognition beyond organizing information?
- sebastiennight 3mo ago
  I'm puzzled by this question. Does the material universe perform any other acts than organizing information? I feel like you're trying to make me argue a position I'm not defending here.
- robotresearcher 3mo ago
  What does 'organizing information' exclude?
rsoto2 3mo ago
Yes. When someone is teaching you language as a baby you have eyes and ears and 100 million nerve endings and constant "training" to understand language. You cannot understand the word "semantics" as a human without this crucial "training" step. My god you people will pull out the most bs metaphors to justify being in awe(and debt) to a software program.

visarga 3mo ago

> There's no possible experience of the world there. No input other than a bunch of imperfect labels we created for stuff. The brain too sits locked inside a bone box and only gets a bundle of unlabeled nerves connecting it to the outside. How can the brain could possibly experience anything, it only sees patters and patterns of patterns never the real thing?

sebastiennight 3mo ago
> a bundle of unlabeled nerves connecting it to the outside As a species, we do need to up our cable management skills. We're likely not getting augmented humans until we get there.
rsoto2 3mo ago
a bone box.. with eyes and 100 million nerve endings to experience the world...