3 ms·

There have been two criticisms of this paper floating around. 1. The test mechanism is to use prediction of sinusoidal series. While it's certainly possible to

There have been two criticisms of this paper floating around. 1. The test mechanism is to use prediction of sinusoidal series. While it's certainly possible to train transformers on mathematical functions, it's not clear why findings from a model trained on sinusoidal functions would generalize into the domain of written human language (which is ironic, given the paper's topic). 2. Even if it were true that these models don't generalize beyond their training, large LLMs' training corpus is basically all of written human knowledge. So then the goalpost has been moved to "well, they won't push the frontier of human knowledge forward," which seems to be a much diminished claim, since the vast majority of humans are also not pushing the frontier of human knowledge forward and instead use existing human knowledge to accomplish their daily goals.

hansvm 3y ago
You're using the idea of "all of human knowledge" differently in the two places it appears, and the gap in those definitions weakens the claim a bit. LLMs are trained on a tiny subset of the written human knowledge which we've proven to probably not be garbage and which is nicely formatted in simple text formats and which was published without too many paywalls on the web and on and on and on. It's a lot, and it definitely includes enough facts that no one person knows all the things the LLM "knows", but the average child knows plenty of things which never made it into that sort of a corpus. Yes, it's probably true that the vast majority of humans are also not pushing the frontier of human knowledge forward, but the vast majority of humans are working with a slightly different (partially overlapping) set of information than what the LLMs see.
- Isomorpheus 3y ago
  Can you name three things an average child knows which GPT-4 doesn't?
  - abeppu 3y ago
    How to drink from a cup without dribbling. The feeling of sunshine on one's skin. The experience of the passage of time.
  - tomohelix 3y ago
    I understand what you are saying so I will address the core of your question instead of just giving you things a child can do. An LLM right now is still just a facsimile of one of human's cognition. Arguably, without the other senses, it can't experience or understand things the same way we can. This leads to the AI unable to form a comparable sentience to a child, at least, not in the same way and not in a way that would be recognized by most people. Someone already gave you the sense of time as an example. These senses are things we were born with and critical to our perception of the surroundings. Until the AI is trained on at least the majority of these senses, a child will always have something they can do that the AI can't.

hansvm 3y ago

You're using the idea of "all of human knowledge" differently in the two places it appears, and the gap in those definitions weakens the claim a bit. LLMs are trained on a tiny subset of the written human knowledge which we've proven to probably not be garbage and which is nicely formatted in simple text formats and which was published without too many paywalls on the web and on and on and on. It's a lot, and it definitely includes enough facts that no one person knows all the things the LLM "knows", but the average child knows plenty of things which never made it into that sort of a corpus. Yes, it's probably true that the vast majority of humans are also not pushing the frontier of human knowledge forward, but the vast majority of humans are working with a slightly different (partially overlapping) set of information than what the LLMs see.

Isomorpheus 3y ago
Can you name three things an average child knows which GPT-4 doesn't?
- abeppu 3y ago
  How to drink from a cup without dribbling. The feeling of sunshine on one's skin. The experience of the passage of time.
- tomohelix 3y ago
  I understand what you are saying so I will address the core of your question instead of just giving you things a child can do. An LLM right now is still just a facsimile of one of human's cognition. Arguably, without the other senses, it can't experience or understand things the same way we can. This leads to the AI unable to form a comparable sentience to a child, at least, not in the same way and not in a way that would be recognized by most people. Someone already gave you the sense of time as an example. These senses are things we were born with and critical to our perception of the surroundings. Until the AI is trained on at least the majority of these senses, a child will always have something they can do that the AI can't.