8 ms·

These are mind bogglingly good

tgv 4y ago
Yes, and it still feels a lot like Searle's Chinese Room. It's as if it skips a dozen steps. Well, that's exactly what happens, of course. But it does show that the network can match linguistic descriptions to images extraordinarily well.
- myrmidon 4y ago
  Do you find the Chinese Room argument convincing? Do you feel that the human mind is more than an "appropriately" trained "biological" neural network? What do you consider the limits of a DALL-E like system compared to a "true" mind? My personal opinion is that the Chinese Room argument is fancy handwaving that crucially relies on never being explicit about what it means by "understanding", combined with an appeal to intuition. I strongly believe that there is nothing "magical" about the human mind or brain (that could not be replicated artificially), and thus that a comparably trained, appropriately designed system ("DALL-E successor") OR a copy OR a simulation of a human brain would be all just as capable and "understanding"/"conscious" as another human...
  - Simon321 4y ago
    > My personal opinion is that the Chinese Room argument is fancy handwaving that crucially relies on never being explicit about what it means by "understanding", combined with an appeal to intuition. bingo
  - notahacker 4y ago
    There doesn't need to be anything "magical" about the human mind for human "understanding" not to be particularly closely approximated by performing mathematical transformations on a huge corpus of raster data, even though the latter approach produces very useful results (see also the utility of a pocket calculator vs attempting to skip a billenium or so of natural evolution to grow an organism motivated to learn multiplication in a petri dish, or parse human minds to figure out the elements of brain state associated with performing a calculation) GPT-3 is far, far better at generating descriptions of loving humanity than the average dog. But it's pretty obvious that the dog's goal formation and excitement hormones aren't particularly similar to letter-by-letter ASCII output probability calculations on a database, and that GPT-3 has no more grasp of the dog's love of humanity in general and this human in particular than the dog has of Shakespeare. "Thought" and intelligible results are essentially orthogonal, which limits the feasibility of training the former...
  - tgv 4y ago
    > My personal opinion is that the Chinese Room argument is fancy handwaving It isn't hand-waving. It's against it, really. It's a thought experiment that encourages a sceptic attitude towards jumps in understanding mental processes. The operator in the Chinese Room doesn't understand Chinese. While the translations are excellent, he or she wouldn't be able to go out in the street and ask for a glass of water if their life depended on it. Hence, a computer that mechanically translates Chinese cannot be automatically assumed to understand Chinese. The argument doesn't need to explain exactly what understanding means. We all (sort of) know what it means. The same goes for e.g. attention. That's what makes it so hard to define what strong AI is and how to verify it. The Turing Test famously tries to decide this (without defining anything, I might add), and the Chinese Room is a good argument against it being the proper test.
    - myrmidon 4y ago
      > The argument doesn't need to explain exactly what understanding means. We all (sort of) know what it means. Then what does "understanding" a language mean? Your "asking for a glass of water on the street" example implies to me that you demand a system with: a) capability for internal intent b) ability to express intent in target language to grant it "understanding". Basically, first you deliberately construct a system not capable of intent (pure stateless query-response algorithm), then you deny that it "understands" Chinese on the basis of being unable to express intent. That does not hold. Give me a precise definition for what you mean by "understanding" and I'll dismantle the Chinese Room for you.
      - tgv 4y ago
        > Give me a precise definition for what you mean by "understanding" and I'll dismantle the Chinese Room for you. You probably can't define "chair" in an exact enough sense. It would merely show the shortcoming of the definition rather than refuting the Chinese Room. > a system not capable of intent If I now would require a definition of "intent" I would be just as childish. > That does not hold. First, the system isn't stateless. It has the operator who has to remember what has happened before in order to come up with a correct translation. Second, your argument implies that understanding requires intent. That alone is a tall order to prove. But it's the point of the Chinese Room: the mechanism doesn't understand, doesn't have intent, nothing. Yet it performs exactly as an intelligent, understanding, intentional translator. So would you not agree with the conclusion: you can't judge intent by only looking at I/O behavior? Note that Searle (probably, this is just my understanding) doesn't mean that the Room is useless or "dumb" (in most senses of the word).
puranjay 4y ago
Kermit in Sopranos did it for me. Hilariously accurate.
coldcode 4y ago
If you ran it 1000 times and picked the best, you might get all good ones. I would want to see all 1000. It's like stock picker ads (person who called the market says XXX) where you only show the lucky ones.
- mensetmanusman 4y ago
  It doesn’t matter if these images were one in 10,000, the facts that any exist that are this good is crazy.
  - abhaynayar 4y ago
    Yeah exactly. The fact that a person who could never create such a picture on their own, now just has to go through a bunch of images and select one to get this result is already amazing. The goal posts keep shifting, glass half empty.
    - phaedrus 4y ago
      It reminds me of pop articles about the P=NP question which simplify it down to, "is being able to recognize creativity the same as being creative?" Turns out for practical purposes, yes (the simplification question not the mathematical question), as long as you can offload the work to an AI on a powerful compute cluster!
    - simiones 4y ago
      It's amazing and wonderful, but it's not the AI that's "creating art", it's the human choosing the best AI output that's doing the artistic part (often togehter with the person who input the prompt to the AI). It's just like Dada poets did 100 years ago: you use a mechanical process to generate quasi-random output, and then you choose some of this output to present to other humans. The way you provide input to the mechanical process (e.g. what words you choose to put in the hat) and the curation are the real creative part of the art, not the mechanical process generating the text itself.
    - coldcode 4y ago

tgv 4y ago

Yes, and it still feels a lot like Searle's Chinese Room. It's as if it skips a dozen steps. Well, that's exactly what happens, of course. But it does show that the network can match linguistic descriptions to images extraordinarily well.

myrmidon 4y ago
Do you find the Chinese Room argument convincing? Do you feel that the human mind is more than an "appropriately" trained "biological" neural network? What do you consider the limits of a DALL-E like system compared to a "true" mind? My personal opinion is that the Chinese Room argument is fancy handwaving that crucially relies on never being explicit about what it means by "understanding", combined with an appeal to intuition. I strongly believe that there is nothing "magical" about the human mind or brain (that could not be replicated artificially), and thus that a comparably trained, appropriately designed system ("DALL-E successor") OR a copy OR a simulation of a human brain would be all just as capable and "understanding"/"conscious" as another human...
- Simon321 4y ago
  > My personal opinion is that the Chinese Room argument is fancy handwaving that crucially relies on never being explicit about what it means by "understanding", combined with an appeal to intuition. bingo
- notahacker 4y ago
  There doesn't need to be anything "magical" about the human mind for human "understanding" not to be particularly closely approximated by performing mathematical transformations on a huge corpus of raster data, even though the latter approach produces very useful results (see also the utility of a pocket calculator vs attempting to skip a billenium or so of natural evolution to grow an organism motivated to learn multiplication in a petri dish, or parse human minds to figure out the elements of brain state associated with performing a calculation) GPT-3 is far, far better at generating descriptions of loving humanity than the average dog. But it's pretty obvious that the dog's goal formation and excitement hormones aren't particularly similar to letter-by-letter ASCII output probability calculations on a database, and that GPT-3 has no more grasp of the dog's love of humanity in general and this human in particular than the dog has of Shakespeare. "Thought" and intelligible results are essentially orthogonal, which limits the feasibility of training the former...
- tgv 4y ago
  > My personal opinion is that the Chinese Room argument is fancy handwaving It isn't hand-waving. It's against it, really. It's a thought experiment that encourages a sceptic attitude towards jumps in understanding mental processes. The operator in the Chinese Room doesn't understand Chinese. While the translations are excellent, he or she wouldn't be able to go out in the street and ask for a glass of water if their life depended on it. Hence, a computer that mechanically translates Chinese cannot be automatically assumed to understand Chinese. The argument doesn't need to explain exactly what understanding means. We all (sort of) know what it means. The same goes for e.g. attention. That's what makes it so hard to define what strong AI is and how to verify it. The Turing Test famously tries to decide this (without defining anything, I might add), and the Chinese Room is a good argument against it being the proper test.
  - myrmidon 4y ago
    > The argument doesn't need to explain exactly what understanding means. We all (sort of) know what it means. Then what does "understanding" a language mean? Your "asking for a glass of water on the street" example implies to me that you demand a system with: a) capability for internal intent b) ability to express intent in target language to grant it "understanding". Basically, first you deliberately construct a system not capable of intent (pure stateless query-response algorithm), then you deny that it "understands" Chinese on the basis of being unable to express intent. That does not hold. Give me a precise definition for what you mean by "understanding" and I'll dismantle the Chinese Room for you.
    - tgv 4y ago
      > Give me a precise definition for what you mean by "understanding" and I'll dismantle the Chinese Room for you. You probably can't define "chair" in an exact enough sense. It would merely show the shortcoming of the definition rather than refuting the Chinese Room. > a system not capable of intent If I now would require a definition of "intent" I would be just as childish. > That does not hold. First, the system isn't stateless. It has the operator who has to remember what has happened before in order to come up with a correct translation. Second, your argument implies that understanding requires intent. That alone is a tall order to prove. But it's the point of the Chinese Room: the mechanism doesn't understand, doesn't have intent, nothing. Yet it performs exactly as an intelligent, understanding, intentional translator. So would you not agree with the conclusion: you can't judge intent by only looking at I/O behavior? Note that Searle (probably, this is just my understanding) doesn't mean that the Room is useless or "dumb" (in most senses of the word).

puranjay 4y ago

Kermit in Sopranos did it for me. Hilariously accurate.

coldcode 4y ago

If you ran it 1000 times and picked the best, you might get all good ones. I would want to see all 1000. It's like stock picker ads (person who called the market says XXX) where you only show the lucky ones.

mensetmanusman 4y ago
It doesn’t matter if these images were one in 10,000, the facts that any exist that are this good is crazy.
- abhaynayar 4y ago
  Yeah exactly. The fact that a person who could never create such a picture on their own, now just has to go through a bunch of images and select one to get this result is already amazing. The goal posts keep shifting, glass half empty.
  - phaedrus 4y ago
    It reminds me of pop articles about the P=NP question which simplify it down to, "is being able to recognize creativity the same as being creative?" Turns out for practical purposes, yes (the simplification question not the mathematical question), as long as you can offload the work to an AI on a powerful compute cluster!
  - simiones 4y ago
    It's amazing and wonderful, but it's not the AI that's "creating art", it's the human choosing the best AI output that's doing the artistic part (often togehter with the person who input the prompt to the AI). It's just like Dada poets did 100 years ago: you use a mechanical process to generate quasi-random output, and then you choose some of this output to present to other humans. The way you provide input to the mechanical process (e.g. what words you choose to put in the hat) and the curation are the real creative part of the art, not the mechanical process generating the text itself.
  - coldcode 4y ago