3 ms·

This confirms some of the suspicions I've had after playing with DALL-E for a few months. In the good examples I see from Dall-E, oftentimes the things that it

This confirms some of the suspicions I've had after playing with DALL-E for a few months. In the good examples I see from Dall-E, oftentimes the things that it frequently does wrong (face symmetry, hands, feet, limbs) are just missing altogether because they're not needed to produce the prompt. Even in some of the good ones, a lot of elements out of focus seem to get smeared into other objects quite often, or the "smudginess" contributes to its surreal style. People keep saying that sort of problem with be optimized away, but people often underestimate that when a technology plateaus at a certain point it usually requires a completely new innovation to get past some of the hurdles - not just optimization. It can take decades for those innovations to arrive. Of course I don't have enough specialized knowledge to know if that's really the case here but it's an observation I've noticed about hyped technologies in my lifetime.

godelski 4y ago
Well IIRC DALL-E specifically in their public release tries to censor humans. But other works like Stable Diffusion and Midjourney do not have these restrictions. Still, both are quite terrible at human faces. This is always interesting because generative tasks like FFHQ or CelebA have always been considered easy (despite humans being quite adept at recognizing when something is wrong with a face). But being able to create whole scenes requires a substantial amount of diversity. A good network can both memorize and create. There are some technical details that I am certain will be resolved (like long range features) simply due to increased hardware power/memory. But alignment will still be quite difficult as the entire problem is ill-defined to begin with. But to give you some hints of how to use DALL-E better, there are magic keywords and this is why people suggest pretending like you're writing a prompt as if the thing exists. Some of these magic words are: screenshot, unreal engine, photorealistic, studio Ghibli. It does better with anime styles, probably due to training and human interpretations. Try to write longer prompts too. For example "flying otters" will give you otters in the water but "a photorealistic unreal engine render of otters flying through a beautiful sunset" will give you something much closer to what you actually want.
- boredtofears 4y ago
  Interesting. Thank you.

godelski 4y ago

Well IIRC DALL-E specifically in their public release tries to censor humans. But other works like Stable Diffusion and Midjourney do not have these restrictions. Still, both are quite terrible at human faces. This is always interesting because generative tasks like FFHQ or CelebA have always been considered easy (despite humans being quite adept at recognizing when something is wrong with a face). But being able to create whole scenes requires a substantial amount of diversity. A good network can both memorize and create. There are some technical details that I am certain will be resolved (like long range features) simply due to increased hardware power/memory. But alignment will still be quite difficult as the entire problem is ill-defined to begin with. But to give you some hints of how to use DALL-E better, there are magic keywords and this is why people suggest pretending like you're writing a prompt as if the thing exists. Some of these magic words are: screenshot, unreal engine, photorealistic, studio Ghibli. It does better with anime styles, probably due to training and human interpretations. Try to write longer prompts too. For example "flying otters" will give you otters in the water but "a photorealistic unreal engine render of otters flying through a beautiful sunset" will give you something much closer to what you actually want.

boredtofears 4y ago
Interesting. Thank you.