2 ms·
The first comment on that article is from gwern (author of thiswaifudoesnotexist.net) and goes into a lot of details about where these limitations may come from
by PoignardAzur 4y ago
The first comment on that article is from gwern (author of thiswaifudoesnotexist.net) and goes into a lot of details about where these limitations may come from.
> The problem with these samples generally doesn't seem to be that the objects rendered are rendered badly by GLIDE or the upscalers, the problem seems to be that the objects are just organized wrong because the DALL-E 2 system as a whole didn't understand the text input - that is, CLIP gave GLIDE the wrong blueprint and that is irreversible. And we know that GLIDE can do these things better because the paper shows us how much better one pair of prompts are (no extensive or quantitative evaluation, however)
> So, these DALL-E 2 problems all look soluble to me by pursuing just known techniques. They stem from either deliberate choices, removing the user's ability to choose a different tradeoff, or lack of simple-minded scaling.
I really recommend reading the whole comment.
tl;dr: There are very good reasons to suspect most of DALL-E's currently identified limitations might be gone within one or two years.