4 ms·
It's interesting how some of them are described as limitations. I can't understand the designer photograph prompt either, and not just because of the "operated"
by viraptor 5y ago
It's interesting how some of them are described as limitations. I can't understand the designer photograph prompt either, and not just because of the "operated" part. The mazes look great to me. And the million apples look like what I'd expect from a photo called "a million apples".
If it learns from humans and produces results like humans would... What's the definition of "limitation" here?
- aetherson 5y agoThe maze that looks more or less like a maze at first glance is full of disconnected sections that can't be reached by each other. It's missed a really essential part of being a maze. (The hedge maze doesn't look like a hedge maze at all: I'm kind of surprised that DALL-E isn't able to figure out that consistent width of the passages is a part of hedge mazes). The designer photograph one is complicated and I'm not surprised that DALL-E misunderstand it. But you're cherry-picking for the apples. It didn't consistently give an picture of five apples when asked for five apples. When asked for a bowl of fruit with no apples, it gives a bowl of only apples. That's obviously strongly sub-human comprehension.
- viraptor 5y agoI totally picked the examples - some are definitely deficiencies, but I wanted to concentrate on the debatable ones. A counterpoint to the maze - it depends what we expect. If you wanted a maze designed, it would be of course a bad example. But if you wanted one painted, it's... good? If it was in a gallery, it could easily be a commentary on life with limitations, dead ends and problems we can't solve.
- 2muchcoffeeman 5y agoI’d argue an unsolvable maze is art only if the artist can conceive of and understands the metaphor. Or can at least comprehend that they are doing mazes with no solution. The computer has no understanding of what it’s doing. And I don’t think you can argue that it’s interrupting a brief for a commission. Is it even producing at???
- kian 5y agoI think it is the person perceiving that transforms the work into art. If they can perceive the metaphor, why does it matter if the artist cannot?
- 2muchcoffeeman 5y agoThat could be true. But it’s a bit awkward no? A human needs to be there at the beginning to either dream up a concept and then describe it in painful detail to the computer. Or a human needs to be there at the end to sift through the results to pick out the ones that actually match some concept. In trying to think of a useful application for this: if an artist can lock down the style of the output, and then pump in a script and further description to story board things or get near final output, that could be quite useful.
- jameshart 5y agoAre you familiar with the empirical results that have been observed when you ask a human to 'draw a bicycle'? https://www.booooooom.com/2016/05/09/bicycles-built-based-on-peoples-attempts-to-draw-them-from-memory/ https://www.booooooom.com/2016/05/09/bicycles-built-based-on... People draw bicycle-like shapes, that don't quite work - they miss important details, or connect things that shouldn't be connected.
- woodruffw 5y agoThis is a funny comparison to draw, but I don't think it's one with profound meaning: humans have trouble drawing bicycles, but the semantics of a badly-drawn bicycle are sound. This is in contrast to DALL-E, which might do an excellent job of drawing apples but otherwise misses the semantics of the query (i.e., "without apples"). In other words: humans mis-draw things because we don't always do a good job of visually apprehending the world; DALL-E mis-draws things because it doesn't really understand the problem statement.
- native_samples 5y agoThe semantics aren't that sound - a lot of the bikes have the seat at the very back, too far from the handlebars.
- woodruffw 5y agoNone of them are good, but the semantics are correct: the seat is behind the handlebars, the handlebars curve correctly, &c. The fact that humans tend to draw the pieces too far apart is more a testament to our problems drawing scale and perspective than a semantic error. (I think this would be apparent if participants were asked to draw a bicycle, followed by a bicycle without a wheel. The two drawings would be roughly as "good" in terms of quality, but the humans will correctly obey the prompt and omit one of the two wheels. I suspect DALL-E would struggle with that prompt.)
- dtech 5y agoThis is from memory. Humans wouldn't make this (serious level) of mistakes if they had an enormous data-set of bicycles to draw from.
- chubot 5y agoIf it learns from humans and produces results like humans would. No, humans can understand "A red cube, on top of a yellow cube, to the left of a green cube" and draw it. Dall-E gives you nonsense -- look at the picture. It fundamentally doesn't understand things that humans do. That is limitation. Of course it might be great overall and do things that humans can't, but it still has a limitation. Gary Marcus has been hammering this home at least since 2018, probably earlier. It's more of a memory/association/recall machine than a machine that understands, and understands logic in particular.
- viraptor 5y ago> "how some of them are described as limitations"
- deleted 5y ago[deleted]
- js8 5y agoI agree it doesn't understand. I believe we will have an AGI when you ask it to draw: "seven red lines, all of them perpendicular, some in green ink, some transparent, in the shape of a kitten" Then it will respond: "FU, it cannot be drawn!"
- iggldiggl 5y agoOr do something like this: https://www.youtube.com/watch?v=B7MIJP90biM https://www.youtube.com/watch?v=B7MIJP90biM
- newswasboring 5y agoNow I want someone to feed this classic prompt to DALL-E
- jameshart 5y agoThis seems tractable though. GPT-3 can complete this prompt: clarify this scene description: A bowl of fruit containing no apples With The bowl contains bananas, oranges, and grapes. So the semantic modeling is certainly doable.