3 ms·
Yes, DALL-E2 clearly gets confused when dealing with multiple objects, where each object is given specific attributes. However, it does answer SOME of these ty
by drcode 4y ago
Yes, DALL-E2 clearly gets confused when dealing with multiple objects, where each object is given specific attributes.
However, it does answer SOME of these types of prompts correctly: It often correctly handles the simplest case of two objects with one specific property each.
My prediction is that since it can handle SOME of these cases already, it means this problem has shown itself to be tractable, and future ML researchers will be able to chip away at the deficiencies with additional effort.
I'm confident the next versions of these AI systems will handle the prompts given in this paper with ease.
- jandrese 4y agoFrom what I've read elsewhere DALL-E2 can't handle overly long/complex requests. Pretty much everybody who has tried it has discovered the same thing. Keep the requests simple.
- ravi-delia 4y agoI bet a lot of the issue is just the CLIP encoding. It's doing a ton of work getting text prompts into vector form, and it's incredible it does so well as is, but past a point you're squeezing blood from a stone. It's just not a full language model! Bump up the size, or figure something out about the space it's working in, I bet you'd see huge improvements.