7 ms·
I'd go one step further: Humans themselves don't understand anything, we are just good at constructing logical-sounding (plausible, testable) stories about thin
by jvanderbot 6y ago
I'd go one step further: Humans themselves don't understand anything, we are just good at constructing logical-sounding (plausible, testable) stories about things. These are mental models, and it's the only way we can make reasonable predictions to within error tolerances of our day-to-day experience, but they are flat-out lies and stories we tell ourselves not based on a high-fidelity understanding of anything.
Rumination, deep thinking, etc is simply actor-critic learning of these mental models for story-telling.
- soulofmischief 6y agoMental models are not lies. "The car is red" is not a lie just because I didn't phrase it internally as "The car reflects photons of a frequency of around 700nm". We have to be able to simplify and internalize simplified models in order to make any sense of anything. It's the same reason your eyes only have a focal point in the dead center: attention requires vast amounts of processing power. To reiterate, a simplification is not a lie. Especially not a flat-out lie.
- Turing_Machine 6y agoYes. Bridges are designed using old-school Newtonian mechanics, without (in general) considering relativistic or quantum effects at all, but they stand up nonetheless. That wouldn't be the case if they were built based on "flat-out lies". Edit: the sticking point here is the use of the word "lie", I think. A lie is a falsehood told with intent to deceive. Thus, novels are not "lies", despite being works of the imagination. Everyone knows that the people in Moby-Dick or Wuthering Heights were made up. Neither is a simplified model a "lie" if it is close enough. All engineers know that the steel and concrete components of a bridge have quantum and relativistic effects going on inside them, so ignoring those effects isn't a "lie" in any meaningful sense. It just doesn't matter for the purpose at hand.
- vladTheInhaler 6y agoThis is sort of a digression, sort of a return to the original topic. As I was reading the sentence about Moby-Dick, I wondered if perhaps someday this comment section would become part of a training corpus for GPT-9001 or whatever. Then a researcher might read it a paragraph from Moby-Dick and ask it whether those events actually happened or whether they were fictional. And it might answer "Of course they were made up. Everyone knows that the people in Moby-Dick or Wuthering Heights were made up." And if the researcher asked it to explain how it could know anything about what is fiction and what is not, it might be able to use the contents of these comments to figure out how to converse intelligently about its own limitations.
- cscurmudgeon 6y agoBut you claim to understand right in this comment how humans understand other things. Isn't that self-contradictory?
- p1esk 6y agoHe's just not very good at constructing logical-sounding (plausible, testable) stories about things :)
- xdavidliu 6y agono he did not claim so. His claim is just as much a lie as all other claims. Lies can be valuable, even if they are not strictly true.
- cscurmudgeon 6y agoWhat about your comment? Is that a lie too? :)
- xdavidliu 6y agoof course, yes. Not in the sense that it's 0 percent true, but rather in the sense that it's not 100 percent true.
- runT1ME 6y agoDo current NLP systems understand arithmetic, and can the do it with unfamiliar numbers they've never seen on? If not, I'd think that your theory is demonstratably false, as a child can extrapolate mathematical axioms from just a few example problems, whereas NLP models are not able to do so.
- glenstein 6y ago>Do current NLP systems understand arithmetic, and can the do it with unfamiliar numbers they've never seen on? I don't know if that question is rhetorical or not, but GPT-3 can do basic math for problems it has not been directly trained on, and there's been a fair amount of debate, including right here at hn, about what the takeaway is supposed to be.
- YeGoblynQueenne 6y agoGPT-3 can't do arithmetic very well at all. There is a big, fat, extraordinary claim that it can in the GPT-3 paper but it's only based on perfect accuracy on two-digit addition and subtraction, ~90% accuracy on three digit addition and subtraction and ... around 20% accuracy on addition and substraction between from three to five digits and multiplication from between two measly digits. Note: no division at all and no arithmetic with more than five digits. And very poor testing to ensure that the solved problems don't just happen to be in the model's training dataset to begin with, which is the simplest explanation of the reported results given that the arithmetic problems GPT-3 solves correctly are the ones that are most likely to be found in a coprus of natural language (i.e. two- and three- digit addition and subtraction). tl;dr, GPT-3 can't do basic math for problems it has not been directly trained on. ____________ [1] https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165 See section 3.9.1 and Figure 3.10. There is an additional category of problems of combinations of addition, subtraction and multiplication between three single-digit numbers. Performance is poor.
- avmich 6y ago>but it's only based on perfect accuracy on two-digit addition and subtraction, ~90% accuracy on three digit addition and subtraction and ... Which grade of school it corresponds to? It would be astonishing to have an AI system of this capability level mere few years ago.
- bananaface 6y agoI get what you're saying, but I think this is a side-effect of saving thinking in abstractions. We use abstractions to plug holes to avoid having to drill down on every concept we're exposed to. That can look like a surface-level linguistic understanding, but it's not, it's a surface-level abstraction. It's not arbitrary, it has structure, and when you flesh it out you're fleshing it out with actual abstract structure, not just painting over the gaps with arbitrary language.