3 ms·

So this method seems to create an inner core "skeleton" that is then used with various shells. How is this method compared to a commercial product such as Pose

• qayxc 5y ago
  Does Poser work with photos and videos as inputs? If not, there's your answer.
  • bsenftner 5y ago
    No.
• gedy 5y ago
  You don't need to create or capture a mesh. This is synthesizing one from a few 2d images, with impressively accurate results.
• wokwokwok 5y ago
  Poser requires an existing rigged, textured mesh. Poser requires that you manually animate the skeleton. This approach is more like a mixture of mocap/photometry; given an input video (a) and (b), synthesise a fully textured model from (a) and apply the motion from (b) on it. Of course, the output of this is horribly bad compared to state of the art 3d models; the point is that the inputs are trivial and it shows that NeRF are increasingly plausible as a solution for real use cases. Of course... this is all a bit 'proof of concept stuff'. > To further evaluate our method on a wider variety of body poses and more challenging textured clothing, we captured a new multi-view human performance corpus with 79 − 86 cameras at a resolution of 1285 × 940. It contains four sequences, 𝑁1-𝑁4, and each has 12,000−16,000 frames for training and around 8, 000 frames for testing These captured images are also, notably, green screen, although not with the traditional mocap markers. So, no, you're not going to get a 3d animation from a video off your phone anytime even remotely soon. ...but, it's still pretty darn awesome, and they're going to release the datasets for others to play with.