4 ms·

I think Nano Banana Pro should have passed your giraffe test. It's not a great result but it is exactly what you asked for. It's no worse than Seedream's result

by sosodev 11mo ago

I think Nano Banana Pro should have passed your giraffe test. It's not a great result but it is exactly what you asked for. It's no worse than Seedream's result imo.

kevlened 11mo ago
I agree. From where I'm sitting, Seedream just bent the neck while Nano Banana Pro actually shortened the neck.
vunderba 11mo ago
Yeah I think that's a fair critique. It kind of looks like a bad cut-and-replace job (if you zoom in you can even see part of the neck is missing). I might give it some more attempts to see if it can do a better job. I agree that Seedream could definitely be called out as a fail since it might just be a trick of perspective.
- sefrost 11mo ago
  Have you ever considered a “partial pass”? Perhaps it would be an easy cop out of making a decision if you had to choose something outside of pass/fail.
  - vunderba 11mo ago
    That's not a bad suggestion. I thought about adding a numerical score but it felt like it was bit overwhelming at the time. Maybe I should revisit it though in the form of: Fail = 0 points Partial = 0.5 points Success = 1 point There's definitely a couple of pictures where I feel like I'm at the optometrist and somehow failing an eye exam (1 or 2, A... or B).
    - jofzar 11mo ago
      I agree with this, some of those are "passing" and others are really passing. Specially with how much better some of the new model is compared to old ones. I think the paws one is a good example where I think the new model got 100% while the other was more like 75%
jonplackett 11mo ago
Yeah it’s better than the weirdness of seedream for sure.
aqme28 11mo ago
I don’t understand at all why Seedream gets a pass there. The neck appears the same length but now it’s at a different angle.
- vunderba 11mo ago
  Alright I think it's time to concede defeat! Seedream has been summarily demoted to a failure and I've added in the following minimum passing criteria to that particular test: - The giraffe's neck should be noticeably shorter than in the original image, while still maintaining a natural appearance. - The final image cannot be accomplished by simply cropping out the neck or using perspective changes.

by sosodev 11mo ago

I think Nano Banana Pro should have passed your giraffe test. It's not a great result but it is exactly what you asked for. It's no worse than Seedream's result imo.

kevlened 11mo ago

I agree. From where I'm sitting, Seedream just bent the neck while Nano Banana Pro actually shortened the neck.

vunderba 11mo ago

Yeah I think that's a fair critique. It kind of looks like a bad cut-and-replace job (if you zoom in you can even see part of the neck is missing). I might give it some more attempts to see if it can do a better job. I agree that Seedream could definitely be called out as a fail since it might just be a trick of perspective.

sefrost 11mo ago
Have you ever considered a “partial pass”? Perhaps it would be an easy cop out of making a decision if you had to choose something outside of pass/fail.
- vunderba 11mo ago
  That's not a bad suggestion. I thought about adding a numerical score but it felt like it was bit overwhelming at the time. Maybe I should revisit it though in the form of: Fail = 0 points Partial = 0.5 points Success = 1 point There's definitely a couple of pictures where I feel like I'm at the optometrist and somehow failing an eye exam (1 or 2, A... or B).
  - jofzar 11mo ago
    I agree with this, some of those are "passing" and others are really passing. Specially with how much better some of the new model is compared to old ones. I think the paws one is a good example where I think the new model got 100% while the other was more like 75%

jonplackett 11mo ago

Yeah it’s better than the weirdness of seedream for sure.

aqme28 11mo ago

I don’t understand at all why Seedream gets a pass there. The neck appears the same length but now it’s at a different angle.

vunderba 11mo ago
Alright I think it's time to concede defeat! Seedream has been summarily demoted to a failure and I've added in the following minimum passing criteria to that particular test: - The giraffe's neck should be noticeably shorter than in the original image, while still maintaining a natural appearance. - The final image cannot be accomplished by simply cropping out the neck or using perspective changes.