4 ms·
> I'd have to have world-class running speed at all. Or he was really sick or something. > So 3/5 correct seems like a non-trivial accomplishment. It's defin
by thayne 4y ago
> I'd have to have world-class running speed at all.
Or he was really sick or something.
> So 3/5 correct seems like a non-trivial accomplishment.
It's definitely a non-trivial accomplishment. And it does show that Imagen can get it right sometimes. But with a sample size of 5, you certainly don't have enough data to say it can consistently get descriptions like these right 3/5 of the time.
And the question at hand isn't "can it draw what I asked it to instead of random garbage" it's "can it combine multiple parts of a sentence in the correct way", which, assuming that determining the correct components is already a solved problem, doesn't have as many degrees of freedom. For example in the "astronaut riding a horse" example, if it has half of the results with an astronaut riding a horse, and half with a horse riding an astronaut, it clearly doesn't understand how it is composed, but you still have a decent chance of getting the right image. Especially if you take 10 samples and pick the best one.