3 ms·

The way I understand the paper, his is still a domain-specific tasks, and it is interpolating. What (according to the paper) transformer models are bad at, is o

The way I understand the paper, his is still a domain-specific tasks, and it is interpolating. What (according to the paper) transformer models are bad at, is out-of-domain extrapolation (which given that modern models are basically trained on all the internet is kinda uncommon).

vidarh 3y ago
If so, then I'd argue that most of humans' "out of domain extrapolation" is domain-specific interpolation as well, and that most humans would struggle to meet the bar.
- simbolit 3y ago
  No disagreement. This is only relevant for the AI-bro fantasy of AI becoming exponentially smarter than humans.
  - vidarh 3y ago
    I don't think it's clear whether or not extrapolation in a sense that'd clear that bar is of much relevance to becoming smart at all.
    - simbolit 3y ago
      The AI-bro fantasy is of AI building a smarter AI, which then builds an even smarter one. If this isn't extrapolation, does it exist?
      - vidarh 3y ago
        I'm not sure whether that requires extrapolation or not. It depends on what you consider extrapolation. I'd be pretty sceptical of the notion that it requires extrapolation on the basis of a use of the term as extreme as the one above. (And btw., if that is what you consider the "AI-bro fantasy" then I'm firmly in that camp. There is no logical reason to assume that's not possible; short of identifying a non-deterministic, non-materialistic source of intelligence in human brains that violates known physics and that we can't emulate, it's just a question of when, not if, and the reason for not going full tilt on that right now is down to a variant of the Wait Calculation, not a need for intelligence to kick it off - that is, trying to kickstart that now is likely to be more expensive and not be any faster than trying to kickstart it next year, and so on, and the question is guessing at when that stops being true)

vidarh 3y ago

If so, then I'd argue that most of humans' "out of domain extrapolation" is domain-specific interpolation as well, and that most humans would struggle to meet the bar.

simbolit 3y ago
No disagreement. This is only relevant for the AI-bro fantasy of AI becoming exponentially smarter than humans.
- vidarh 3y ago
  I don't think it's clear whether or not extrapolation in a sense that'd clear that bar is of much relevance to becoming smart at all.
  - simbolit 3y ago
    The AI-bro fantasy is of AI building a smarter AI, which then builds an even smarter one. If this isn't extrapolation, does it exist?
    - vidarh 3y ago
      I'm not sure whether that requires extrapolation or not. It depends on what you consider extrapolation. I'd be pretty sceptical of the notion that it requires extrapolation on the basis of a use of the term as extreme as the one above. (And btw., if that is what you consider the "AI-bro fantasy" then I'm firmly in that camp. There is no logical reason to assume that's not possible; short of identifying a non-deterministic, non-materialistic source of intelligence in human brains that violates known physics and that we can't emulate, it's just a question of when, not if, and the reason for not going full tilt on that right now is down to a variant of the Wait Calculation, not a need for intelligence to kick it off - that is, trying to kickstart that now is likely to be more expensive and not be any faster than trying to kickstart it next year, and so on, and the question is guessing at when that stops being true)