3 ms·

"What is the real criterion for a machine to be considered intelligent?" For me, AGI. Intelligence is a very complex problem, we tended to meassure it by extr

"What is the real criterion for a machine to be considered intelligent?" For me, AGI. Intelligence is a very complex problem, we tended to meassure it by extreme outliers, evolution did not optimize fore. Like abstract math. Machines clearly are better at everything with calculations. A criterium we reserved for "intelligence". But "simple" things like understanding what a rock is, are still too hard for AI. They can reproduce and recombine some text snippets about rocks, but they do not understand, what a rock is. Or anything as far as I am aware. So they are clearly useful and do things, we described as intelligenz when humans are doing it. But human intelligence is still superior as it is a general intelligence.

p-e-w 3y ago
> They can reproduce and recombine some text snippets about rocks, but they do not understand, what a rock is. What is the difference between "recombin[ing] some text snippets about rocks", and understanding what a rock is? I'm not asking philosophically. I'm asking how you can tell the two apart. (BTW, transformer LLMs do not operate by recombining text snippets.)
- palata 3y ago
  > I am not asking philosophically. That is a philosophical question, though... To me, it sounds like this: "How can I prove that I 'exist'? I'm not asking philosophically, I'm just asking how to do it".
kingkongjaffa 3y ago
Your rock thing gets to the heart of the issue, LLM’s are a statistical mimic of what an actual intelligence might say.
- quickthrower2 3y ago
  An actual intelligence is just a matter of the architecture and compute power though, right?
moffkalast 3y ago
Good luck defining AGI to any measurable degree, especially with the spectrum that it almost certainly is. > But "simple" things like understanding what a rock is Well, how does one verify that an entity understands what a rock is? The education system clearly has no idea how to test for understanding of literally anything. It all fundamentally boils down to testing for consciousness, which is impossible. A sufficiently advanced automaton is indistinguishable from a conscious being to any outside queries.
- hutzlibu 3y ago
  "Well, how does one verify that an entity understands what a rock is? " For starters, it would mean, that it can reliable detect a rock on an image, e.g. recognizing the characteristical traits of a rock. Currently a apple gets recognized as an iPod, when there is a label on it saying so. "When we put a label saying “iPod” on this Granny Smith apple, the model erroneously classifies it as an iPod in the zero-shot setting,’ " https://www.theguardian.com/technology/2021/mar/08/typographic-attack-pen-paper-fool-ai-thinking-apple-ipod-clip https://www.theguardian.com/technology/2021/mar/08/typograph... So this specific flaw might have been fixed by now, but the general shortcoming is, that it has no understanding of the concept of an apple. Or a rock. Or a human. It just "knows" certain pixels arranged in a certain way get the lable apple. "The education system clearly has no idea how to test for understanding of literally anything." And that is very strong hyperbole. There are many, many flaws in the education system, but they do know how to test knowledge (in person). They just do not know how to scale it cheaply, hence the stupid multi choice tests and co.
  - moffkalast 3y ago
    Just gonna leave these here: https://static.independent.co.uk/s3fs-public/thumbnails/image/2016/02/14/12/duck-rabbit.png?width=1200 https://static.independent.co.uk/s3fs-public/thumbnails/imag... https://upload.wikimedia.org/wikipedia/en/2/21/The_dress_blueblackwhitegold.jpg https://upload.wikimedia.org/wikipedia/en/2/21/The_dress_blu... What do you classify it as, a rabbit or a duck? Is the dress blue and black or white and gold? :) Also you do know some people literally fall to the floor and start convulsing if you show them some flashing lights right? Every system has its "glitch tokens". I mean is it really surprising that when you greatly simplify the principle that organic neurons work on, quantize it to the point where it's fast enough to use, have it learn no model of the world besides looking at photos and telling it what it's looking at, that it'd have weird corner cases? I really don't think so. If you want to compare fairly, you'd have to do so with a human that's never spoken to anyone, never seen anything but 2D pictures on a screen in front of them and hasn't been told or shown anything about the world they live in since they were born. And that's would be with the advantage of having six million years of base model training beforehand. > And that is very strong hyperbole. Well sure I guess it's mainly out of lack of care and practicality, but still even more elaborate tests like ones for say, math or physics that have you write the entire procedure don't really test if you understand the underlying principles, just that you've seen that type of problem before and can remember the equations correctly. The LLM bread and butter functionality basically.
Tyr42 3y ago
I mean, I know some humans who would miscatacorize a mineral as a dock sometimes, are they not intelligent anymore? I'm pretty sure gptchat can get those definitions right better than the average person.
- hutzlibu 3y ago
  " I mean, I know some humans who would miscatacorize a mineral as a dock sometimes, are they not intelligent anymore" Some humans also ain't intelligent, yes. (But of course even the dumbest humans automatically make very complicated calculations in their head, just to maintain body functions. Language is tricky.)

p-e-w 3y ago

> They can reproduce and recombine some text snippets about rocks, but they do not understand, what a rock is. What is the difference between "recombin[ing] some text snippets about rocks", and understanding what a rock is? I'm not asking philosophically. I'm asking how you can tell the two apart. (BTW, transformer LLMs do not operate by recombining text snippets.)

palata 3y ago
> I am not asking philosophically. That is a philosophical question, though... To me, it sounds like this: "How can I prove that I 'exist'? I'm not asking philosophically, I'm just asking how to do it".

kingkongjaffa 3y ago

Your rock thing gets to the heart of the issue, LLM’s are a statistical mimic of what an actual intelligence might say.

quickthrower2 3y ago
An actual intelligence is just a matter of the architecture and compute power though, right?

moffkalast 3y ago

Good luck defining AGI to any measurable degree, especially with the spectrum that it almost certainly is. > But "simple" things like understanding what a rock is Well, how does one verify that an entity understands what a rock is? The education system clearly has no idea how to test for understanding of literally anything. It all fundamentally boils down to testing for consciousness, which is impossible. A sufficiently advanced automaton is indistinguishable from a conscious being to any outside queries.

hutzlibu 3y ago
"Well, how does one verify that an entity understands what a rock is? " For starters, it would mean, that it can reliable detect a rock on an image, e.g. recognizing the characteristical traits of a rock. Currently a apple gets recognized as an iPod, when there is a label on it saying so. "When we put a label saying “iPod” on this Granny Smith apple, the model erroneously classifies it as an iPod in the zero-shot setting,’ " https://www.theguardian.com/technology/2021/mar/08/typographic-attack-pen-paper-fool-ai-thinking-apple-ipod-clip https://www.theguardian.com/technology/2021/mar/08/typograph... So this specific flaw might have been fixed by now, but the general shortcoming is, that it has no understanding of the concept of an apple. Or a rock. Or a human. It just "knows" certain pixels arranged in a certain way get the lable apple. "The education system clearly has no idea how to test for understanding of literally anything." And that is very strong hyperbole. There are many, many flaws in the education system, but they do know how to test knowledge (in person). They just do not know how to scale it cheaply, hence the stupid multi choice tests and co.
- moffkalast 3y ago
  Just gonna leave these here: https://static.independent.co.uk/s3fs-public/thumbnails/image/2016/02/14/12/duck-rabbit.png?width=1200 https://static.independent.co.uk/s3fs-public/thumbnails/imag... https://upload.wikimedia.org/wikipedia/en/2/21/The_dress_blueblackwhitegold.jpg https://upload.wikimedia.org/wikipedia/en/2/21/The_dress_blu... What do you classify it as, a rabbit or a duck? Is the dress blue and black or white and gold? :) Also you do know some people literally fall to the floor and start convulsing if you show them some flashing lights right? Every system has its "glitch tokens". I mean is it really surprising that when you greatly simplify the principle that organic neurons work on, quantize it to the point where it's fast enough to use, have it learn no model of the world besides looking at photos and telling it what it's looking at, that it'd have weird corner cases? I really don't think so. If you want to compare fairly, you'd have to do so with a human that's never spoken to anyone, never seen anything but 2D pictures on a screen in front of them and hasn't been told or shown anything about the world they live in since they were born. And that's would be with the advantage of having six million years of base model training beforehand. > And that is very strong hyperbole. Well sure I guess it's mainly out of lack of care and practicality, but still even more elaborate tests like ones for say, math or physics that have you write the entire procedure don't really test if you understand the underlying principles, just that you've seen that type of problem before and can remember the equations correctly. The LLM bread and butter functionality basically.

Tyr42 3y ago

I mean, I know some humans who would miscatacorize a mineral as a dock sometimes, are they not intelligent anymore? I'm pretty sure gptchat can get those definitions right better than the average person.

hutzlibu 3y ago
" I mean, I know some humans who would miscatacorize a mineral as a dock sometimes, are they not intelligent anymore" Some humans also ain't intelligent, yes. (But of course even the dumbest humans automatically make very complicated calculations in their head, just to maintain body functions. Language is tricky.)