3 ms·
Poser requires an existing rigged, textured mesh. Poser requires that you manually animate the skeleton. This approach is more like a mixture of mocap/photome
by wokwokwok 5y ago
Poser requires an existing rigged, textured mesh.
Poser requires that you manually animate the skeleton.
This approach is more like a mixture of mocap/photometry; given an input video (a) and (b), synthesise a fully textured model from (a) and apply the motion from (b) on it.
Of course, the output of this is horribly bad compared to state of the art 3d models; the point is that the inputs are trivial and it shows that NeRF are increasingly plausible as a solution for real use cases.
Of course... this is all a bit 'proof of concept stuff'.
> To further evaluate our method on a wider variety of body poses and more challenging textured clothing, we captured a new multi-view human performance corpus with 79 − 86
cameras at a resolution of 1285 × 940. It contains four sequences, 𝑁1-𝑁4, and each has 12,000−16,000 frames for training and around 8, 000 frames for testing
These captured images are also, notably, green screen, although not with the traditional mocap markers.
So, no, you're not going to get a 3d animation from a video off your phone anytime even remotely soon.
...but, it's still pretty darn awesome, and they're going to release the datasets for others to play with.