Pretty cool. Now, I wonder, can't you label a certain region of space with a prompt, and let the diffuser do its job? Maybe with some mathematical function to b

Pretty cool. Now, I wonder, can't you label a certain region of space with a prompt, and let the diffuser do its job? Maybe with some mathematical function to bend into another area. The idea would be to roughly place the elements in a 3D scene, and adjust the prompt as the camera is moved around the scene. Here, it's obvious that the "fireplace" prompt causes the model to place a new fireplace as the previous one comes out of view. Even if you can't precisely label portions of an image, changing the prompt as the camera moves (or changing the weight coefficients for a prompt describing multiple orientations) would avoid that kind of "unnatural" result. Regardless, impressive results! I wonder if it would perform better if it was re-trained to output a depth channel as well. It could be useful for (artistically) filling gaps in photogrammetry projects. I can't wait for painting or drawing styles to be applied to the output!