4 ms·

Very cool stuff. This is a bit of a tangent, but why are the captures all toothless? Is there something in teeth that makes it hard to capture them? Or is it a

• dchftcs 4y ago
  My guess is that the teeth isn't visible throughout all the frames, so it's hard to reconstruct accurately in 3D. In fact the parts that look like gum and the tongue don't seem to be correct, far from the reconstruction quality of the face itself.
• t-3 4y ago
  They're not? You can clearly see the teeth in the frames where they are visible in the raw. Teeth are just not commonly seen outside unnatural facial movements.
  • dymk 4y ago
    At 1 minute in the video in the mesh reconstruction, the gums / tongue are modeled, and there's clearly no teeth
• pfranz 4y ago
  The short answer is that they're only showing meshes that are deforming. Teeth are rigid and would be put back in based off the jaw and skull position. If memory serves, eyeball position tracking isn't great with this approach, it's not all that hard to add back in, and they often want to cheat eyelines anyway.
• staindk 4y ago
  I think pfranz is on the right track - in one of the other publications they released today they show off how their tech does jaw positioning based on certain constraints (it seems to know where the jaw hinges and how the jaw bone interfaces with the skull).