4 ms·

My gripe with this is that it has no understanding of what the objects are beyond "the thing that's supposed to be output". Its a textbook case of the Chinese r

My gripe with this is that it has no understanding of what the objects are beyond "the thing that's supposed to be output". Its a textbook case of the Chinese room argument [1]. Sure it can follow translation rules, even infer some sophisticated rules and patterns about the slips of paper that are passed in, but it still has no idea what any of it means. https://en.wikipedia.org/wiki/Chinese_room https://en.wikipedia.org/wiki/Chinese_room Dalle is very concerned with the 2d shapes of things we call objects, and has correctly inferred some rules about those shapes, but it neither knows nor cares about the things we call objects and how the shapes it has learned are representations of them. It doesn't do reasoning about the round peg fitting in the round hole. It just glues a few pegs and holes together in a way that's mostly consistent with our expectations and says "is this what you wanted"? Its a student that cares about passing the test, not learning the material.

leereeves 4y ago
Isn't that true of all of us? We all care selectively about certain attributes of objects. I care that my car is quiet and has comfortable seats, I don't care (or know) what material the muffler is made of, but somewhere there is an engineer who cared about that. A road designer cares what the tires are made of and how much it weighs, but doesn't care what color the paint is. An AI recreating an image of my car would care what color the paint is, but not how comfortable the seats are. I think I see what you're describing - the AI has a very limited scope and doesn't know or care about most of the things we do - but I think that's just a limitation of our current small models and limited training data, not an inherent limitation of neural networks.
- IIAOPSW 4y ago
  You may not know what material the muffler is made of, but you know its made of a material. You "care about the objects themselves" in the sense of having this framework of objects, all of which have certain properties and relations to each other which form a predictive model you have about the world. You expect everything to have a position in x,y,z, to have a size, shape, mass, hardness etc. You might not care about a particular property of a particular object in a particular context, but you fundamentally think in the semantics of objects. You know what to expect when the heavy hard object meets the brittle lite object. DallE doesn't really have a system of the semantics of objects. It doesn't know why it would be useless for a building to have all the doors on the 2nd level. Its not even clear that DallE makes use of discrete "objects" in its limited understanding. Here's an example from budget DallE https://ibb.co/B2B5zky https://ibb.co/B2B5zky It understood the shape of "stick figure" and "boobs", but had no understanding of what a stick figure is meant to represent and thus where it should place the boobs. The results are hilarious. I'm not sure which I like more, the guy with a boob casually walking down his arm, or the lady with a boob head that's shrugging with uncertainty.

leereeves 4y ago

Isn't that true of all of us? We all care selectively about certain attributes of objects. I care that my car is quiet and has comfortable seats, I don't care (or know) what material the muffler is made of, but somewhere there is an engineer who cared about that. A road designer cares what the tires are made of and how much it weighs, but doesn't care what color the paint is. An AI recreating an image of my car would care what color the paint is, but not how comfortable the seats are. I think I see what you're describing - the AI has a very limited scope and doesn't know or care about most of the things we do - but I think that's just a limitation of our current small models and limited training data, not an inherent limitation of neural networks.

IIAOPSW 4y ago
You may not know what material the muffler is made of, but you know its made of a material. You "care about the objects themselves" in the sense of having this framework of objects, all of which have certain properties and relations to each other which form a predictive model you have about the world. You expect everything to have a position in x,y,z, to have a size, shape, mass, hardness etc. You might not care about a particular property of a particular object in a particular context, but you fundamentally think in the semantics of objects. You know what to expect when the heavy hard object meets the brittle lite object. DallE doesn't really have a system of the semantics of objects. It doesn't know why it would be useless for a building to have all the doors on the 2nd level. Its not even clear that DallE makes use of discrete "objects" in its limited understanding. Here's an example from budget DallE https://ibb.co/B2B5zky https://ibb.co/B2B5zky It understood the shape of "stick figure" and "boobs", but had no understanding of what a stick figure is meant to represent and thus where it should place the boobs. The results are hilarious. I'm not sure which I like more, the guy with a boob casually walking down his arm, or the lady with a boob head that's shrugging with uncertainty.