3 ms·

All the examples of supposedly 'fixed' hands I've seen still had problems, or relied on poses which hid most of the fingers. Even if the obvious 'can't count t

All the examples of supposedly 'fixed' hands I've seen still had problems, or relied on poses which hid most of the fingers. Even if the obvious 'can't count to five' issue gets fixed, it still has problems correctly rendering knuckles and fingernails and getting good proportions. And people don't even attempt difficult scenes with hands like holding small objects or performing specific actions, presumably because even the most wide-eyed AI-optimist can see how much they don't work.

jsjohnst 4y ago
> And people don't even attempt difficult scenes with hands like holding small objects or performing specific actions They definitely do and with pretty decent (albeit certainly far from perfect) results. I feel you have a bit of cognitive bias based on your sources. A few hundred images of hands well tagged used as fine tuning into an existing SD model produces a dramatic improvement, based on personal experience, including grasping objects. Are they photograph level reproductions, certainly not, but easily qualify as skilled artistic renderings. The part I’ve been experimenting lately on is getting fingernails and skin texture to both be realistic at the same time (I can get one or other, but not both so far).
- YurgenJurgensen 4y ago
  People keep saying things that these models can do, but they're pretty reluctant to actually show any results. Perhaps they're not as good as you claim.
  - jsjohnst 4y ago
    I could show hundreds, but would you trust me or just think they were cherry picked good cases? Skeptical people will be skeptical, news at 11! ;) If you really want to know, you could just try it yourself. Setup WebUI, download some CAI or HF SD models that have been fine tuned with hands, learn about prompting, and then see that the field has dramatically improved by just not using stock settings. Zero to hand model hero in around an hour!
earthboundkid 4y ago
Stable diffusion solved being cross eyed by having everyone wear a space helmet. Done, ship it.

jsjohnst 4y ago

> And people don't even attempt difficult scenes with hands like holding small objects or performing specific actions They definitely do and with pretty decent (albeit certainly far from perfect) results. I feel you have a bit of cognitive bias based on your sources. A few hundred images of hands well tagged used as fine tuning into an existing SD model produces a dramatic improvement, based on personal experience, including grasping objects. Are they photograph level reproductions, certainly not, but easily qualify as skilled artistic renderings. The part I’ve been experimenting lately on is getting fingernails and skin texture to both be realistic at the same time (I can get one or other, but not both so far).

YurgenJurgensen 4y ago
People keep saying things that these models can do, but they're pretty reluctant to actually show any results. Perhaps they're not as good as you claim.
- jsjohnst 4y ago
  I could show hundreds, but would you trust me or just think they were cherry picked good cases? Skeptical people will be skeptical, news at 11! ;) If you really want to know, you could just try it yourself. Setup WebUI, download some CAI or HF SD models that have been fine tuned with hands, learn about prompting, and then see that the field has dramatically improved by just not using stock settings. Zero to hand model hero in around an hour!

earthboundkid 4y ago

Stable diffusion solved being cross eyed by having everyone wear a space helmet. Done, ship it.