Running that image through Segment Anything you get this: https://imgur.com/a/XzCanxx https://imgur.com/a/XzCanxx Imagine if instead of generating the RGB imag

Running that image through Segment Anything you get this: https://imgur.com/a/XzCanxx https://imgur.com/a/XzCanxx Imagine if instead of generating the RGB image directly the model would generate something like that, but with richer descriptive embeddings on each segment, and then having a separate model generating the final RGB image. Then it would be easy to change the background, rotate the peach, change color, add other fruits, etc, by editing this semantic representation of the image instead of wrestling with the prompt to try to do small changes without regenerating the entire image from scratch.