3 ms·

“Humans are trained on orders of magnitude more multimodal data over their lifetimes. Also, humans are not borne as an unbiased model, billions of years of evol

by prng2021 4y ago

“Humans are trained on orders of magnitude more multimodal data over their lifetimes. Also, humans are not borne as an unbiased model, billions of years of evolution have crafted many implicit biases into our cognition (like a propensity to language, facial recognition, etc.).” What in the world are you talking about? I must be talking to chatgpt and am done with this thread. We were originally discussing the differences in methodology between AI and humans for passing standardized exams. Those involve tasks like applying well-defined mathematical concepts to a brand new problem, not “multimodal” data or facial recognition.

naasking 4y ago
If you don't understand what I'm talking about then you don't understand how how these transformer AIs learn and solve problems, so maybe you shouldn't opine about how AI couldn't pass these tests. Your claimed differences between how humans and AIs work is conjecture that can be explained by what I described rather than fundamental differences in how these systems work.
- d0mine 4y ago
  Here's simple example: (x-x+c)=c gpt struggles with such examples if `x` is a large number e.g., x=123_000_000_456 and `c` some specific number, but it is easy for humans.
  - naasking 4y ago
    It's easy for humans once they're taught what variables mean and after 10 or so years of exposure to a real world multimodal training set that's orders of magnitude more data than GPT has seen. Also, algebra is not so easy for people with IQs lower than 90, so not exactly all humans right? What exactly am I supposed infer about how GPT or other AIs and human brains operate from this apples to cars comparison? You don't have to point out failure modes of GPT, I know what they are. The question we're discussing here is what this indicates, if anything, about how these systems operate as compared to human brains, and whether the differences come down to training data or the fundamental architecture.
  - lupire 4y ago
    ChatGPT is not the only AI in the world.

naasking 4y ago

If you don't understand what I'm talking about then you don't understand how how these transformer AIs learn and solve problems, so maybe you shouldn't opine about how AI couldn't pass these tests. Your claimed differences between how humans and AIs work is conjecture that can be explained by what I described rather than fundamental differences in how these systems work.

d0mine 4y ago
Here's simple example: (x-x+c)=c gpt struggles with such examples if `x` is a large number e.g., x=123_000_000_456 and `c` some specific number, but it is easy for humans.
- naasking 4y ago
  It's easy for humans once they're taught what variables mean and after 10 or so years of exposure to a real world multimodal training set that's orders of magnitude more data than GPT has seen. Also, algebra is not so easy for people with IQs lower than 90, so not exactly all humans right? What exactly am I supposed infer about how GPT or other AIs and human brains operate from this apples to cars comparison? You don't have to point out failure modes of GPT, I know what they are. The question we're discussing here is what this indicates, if anything, about how these systems operate as compared to human brains, and whether the differences come down to training data or the fundamental architecture.
- lupire 4y ago
  ChatGPT is not the only AI in the world.