5 ms·
One of the commercial use cases this post mentions is authors who want to add illustrations to children's stories. I wonder if there is a way for DALL-E to gen
by jawns 4y ago
One of the commercial use cases this post mentions is authors who want to add illustrations to children's stories.
I wonder if there is a way for DALL-E to generate a character, then persist that character over subsequent runs. Otherwise, it would be pretty difficult to generate illustrations that depict a coherent story.
Example ...
Image 1 prompt: A character named Boop, a green alien with three arms, climbs out of its spaceship.
Image 2 prompt: Boop meets a group of three children and shakes hands with each one.
- minimaxir 4y agoYou can cheat this to a limited extent using inpainting.
- rahimnathwani 4y agoYou mean just generate a single large image with all the stuff you want for the whole story, and then use cropping and inpainting to get only the piece you want for each page?
- TaupeRanger 4y agoYou can't do that. I can't see this working well for children's book illustrations unless the story was specifically tailored in a way that makes continuity of style and characters irrelevant.
- WalterSear 4y agoI would expect continuuity to be a relatively simple feature to retrain for and implement.
- CobrastanJorji 4y agoAs an aside, Ursula Vernon did pretty well under the constraint you described. She set a comic in a dreamscape and used AI to generate most of the background imagery: https://twitter.com/UrsulaV/status/1467652391059214337 https://twitter.com/UrsulaV/status/1467652391059214337 It's not the "specify the character positions in text" proposed, but still a neat take on using this sort of AI for art.
- TaupeRanger 4y agoNice example and very well done. But yeah, very niche application unfortunately.
- alana314 4y agoWhat AI app did she use, do you know?
- bergenty 4y agoYou cannot. But a workaround would be to say something like “generate an alien in three different poses— running, walking, waving” Then use inpainting to only preserve that pose and generate new content around it. It’s definitely not perfect.
- londons_explore 4y agoYou can do better than this. Draw/generate your character. Then put that at the side of a transparent image, and use as the prompt, "Two identical aliens side by side. One is jumping"
- hiidrew 4y agoI think you can feed it a link to images for inspiration. Wondering if you could just pass the first image to retain 'Boop'.