3 ms·
Hands are manageable and fine most of the time, but I've yet to find a way to describe a complex scene. It can't even get a number of people right half the time
by drdaeman 3y ago
Hands are manageable and fine most of the time, but I've yet to find a way to describe a complex scene. It can't even get a number of people right half the time.
Last thing I've tried was a Distracted Boyfriend meme, but with people dressed like a cat, a cat tree, and a sofa (cardboard cosplay style). Maybe I simply don't know the right way to explain and make it write a perfect prompt, but it was insurmountable task for DALL-E. It always forgot something - either that there should be only three people, or that there's one cat-costumed person, or that a sofa is a costume and not a piece of furniture, or that I wanted to have the obvious canonical layout of the meme and so on. I just gave up.
With Stable Diffusion at least I can do this using iterative inpainting or ControlNet segmentation. DALL-E simply cannot iterate on existing images.
- EnergyAmy 3y agoIf you're using ChatGPT's integration, you'll have to check what text it actually sends to DALL-E, if you didn't already know. Clicking a picture will show the text sent to DALL-E. I've had ChatGPT screw up the instructions up a number of times and have had to say things like "Try again, but this time include this literal string in your prompt to the image generator: '...'"
- drdaeman 3y agoThank you. Yes, I know about this, and I've audited those prompts. E.g. the prompt literally says "glance at the other woman dressed as a sofa", and DALL-E paints a woman sitting on sofa. Or the prompt says "Only the boyfriend should have cat features" but all three people have cat ears (SD is also prone to this, but there's ControlNet). Overall, DALL-E feels like a dumbed-down version Stable Diffusion without repeatability (can't control the generation, so can't reuse the looking-good seed) and a bunch of extra hoops to jump through.
- simonw 3y agoActually it turns out you can reuse seeds in DALL-E 3, and it's surprisingly effective at retaining the same style and image composition across small tweaks to the prompt against that same seed: https://simonwillison.net/2023/Oct/26/add-a-walrus/#reusing-seeds https://simonwillison.net/2023/Oct/26/add-a-walrus/#reusing-...
- drdaeman 3y agoWow, thank you! This is very helpful.