6 ms·
Facial hair tracking for high fidelity performance capture
- staindk 4y agoI've linked to the publication but be sure to check out the video they've embedded. Out of the handful of new publications they released today this one was the most interesting to me - I guess it's because this problem is in many ways more focused and less complex (seeming?) than the others (I'm not an ML/neural networks buff but do find it all interesting).
- vanderZwan 4y agoVery cool stuff. This is a bit of a tangent, but why are the captures all toothless? Is there something in teeth that makes it hard to capture them? Or is it a conscious choice to remove them? I have the same question regarding the eyes.
- dchftcs 4y agoMy guess is that the teeth isn't visible throughout all the frames, so it's hard to reconstruct accurately in 3D. In fact the parts that look like gum and the tongue don't seem to be correct, far from the reconstruction quality of the face itself.
- t-3 4y agoThey're not? You can clearly see the teeth in the frames where they are visible in the raw. Teeth are just not commonly seen outside unnatural facial movements.
- dymk 4y agoAt 1 minute in the video in the mesh reconstruction, the gums / tongue are modeled, and there's clearly no teeth
- pfranz 4y agoThe short answer is that they're only showing meshes that are deforming. Teeth are rigid and would be put back in based off the jaw and skull position. If memory serves, eyeball position tracking isn't great with this approach, it's not all that hard to add back in, and they often want to cheat eyelines anyway.
- staindk 4y agoI think pfranz is on the right track - in one of the other publications they released today they show off how their tech does jaw positioning based on certain constraints (it seems to know where the jaw hinges and how the jaw bone interfaces with the skull).
- antegamisou 4y agoI suspect this is likely to be met with significant kickback, but I'm glad there are people publishing and researching ideas outside the cutting edge, yet easier to get grants for, ML/DL stuff. Not to mention that many researchers have noted the dubious quality of many papers in big ML conferences and no I don't believe they complain because theirs didn't pass peer review. Reading about CS research here, as well as in other media, has become akin to TV zapping and always ending up with the same type of show on every channel.
- UncleEntity 4y ago> I suspect this is likely to be met with significant kickback… Why do you think people would have an issue with them tracking us furry humans?
- garyfirestorm 4y agoI think the implication is that ‘women don’t have facial hair’ and that’s going to be the reason for kickback.
- antegamisou 4y agoI was talking about being a party pooper for not getting very excited by ML research.
- dahart 4y ago
- dotancohen 4y agoThis article assumes that only male actors have facial hair. That's rather nonprogressive of Disney.
- zapdrive 4y agoLol.
- sashahrzg 4y agoReal talk, most people have some amount of facial hair, male or female. A lot of work goes into recreating it as it adds a lot of realism to a render
- dahart 4y agoDisney animation and Pixar are both well known for doing that work, adding subtle hair to female faces in the movies they produce.
- pid_0 4y ago
- charcircuit 4y agoNo, it doesn't. Eyebrows are considered facial hair for this. It mentions that currently males need to shave off their mustache or beard, but that is different from saying women don't have facial hair. Most people haven't shaven off their eyebrows.
- dotancohen 4y agoThis text from the fine article: > actors are asked to shave clean before face capture, which is very often undesirable. Had the additional word "male" yesterday: > male actors are asked to shave clean before face capture, which is very often undesirable. They actually went and changed the text! That is quite typically Disney, for better or for worse. The original text is luckily preserved at the Internet Archive: https://web.archive.org/web/20220724134011/https://studios.disneyresearch.com/2022/07/24/facial-hair-tracking-for-high-fidelity-performance-capture/ https://web.archive.org/web/20220724134011/https://studios.d...
- jeanlucas 4y agoI love whenever Disney makes things like this public. Last one I saw was about snow rendering, some months before Frozen was released
- xattt 4y agoAlthough this link isn’t it, I’m anticipating a time when facial hair tracking may become a proxy measurement mental health well-being - ie individuals who are usually clean shaven all of a sudden start having a five o’clock shadow.
- atlasunshrugged 4y agoWhat about people who usually have beards who suddenly become clean shaven?
- mabbo 4y agoI read your comment, and rubbed my chin, noticing the unusual scratchy beard starting to grow. I think I need a day off.
- xattt 4y agoAre you suggesting direct integration of the StubbleScan into PeopleSoft for automatic scheduling of mental health days and/or automated referral to the Employee Assistance Program?