3 ms·
I think you would need to do some kind of analysis. For example, if your prompt was "red ball on top of blue cube" and you want to know if the results come fro
by ALittleLight 4y ago
I think you would need to do some kind of analysis. For example, if your prompt was "red ball on top of blue cube" and you want to know if the results come from chance you'd need to know the likelihood of the model putting the red ball on top of the blue cube by chance. There are maybe four relative positions for red ball to blue cube - beside, above, below, in, around. Are they each equally likely?
I would try to get a collection of prompts like "red ball and blue cube" or "an empty plane containing only a red ball and a blue cube" and so on - try to come up with 20 or 30 of these. Then, generate 100 images for each prompt. Next, see how likely it is for a red ball to randomly be on top of a blue cube when it was not directed to be.
After gathering some baseline data we could then test three prompts. "Red ball on top of blue cube" and "Red ball beside blue cube" and "Red ball below blue cube". Generate 100 or 1000 images for each of these prompts. Count respective orientations. Then, decide whether red ball being on top of blue cube is more likely than the baseline when the specific direction is given and whether it is less likely when contrary directions are given.
- ummonk 4y agoIt might understand that there is a cube, there is a ball, the scene has red and blue parts, and there is a vertical placement (“on top of”). In that case it would get 1 out of 4 images right.
- ALittleLight 4y agoYes, it might, but that should be settled by experiment rather than speculation.