3 ms·
Production-Level Facial Capture Using Deep Convolutional Neural Networks
- CharlesLiuCN 9y agoThis is really awesome,this will stimulate the movie industry.
- JabavuAdams 9y agoThe movie industry already has these tools. This'll really stimulate indie games, if they can now do AAA mocap.
- bitL 9y agoFantastic! Thanks for another amazing Deep Learning paper to study and play with!
- ungaro 9y agohow can you play with this without any data? "The training data used for the deep neural network was generated using Remedy Entertainment’s in-house capture pipeline based on a cutting edge commercial DI4D PRO system [Dimensional Imaging 2016] that employs nine video cameras."
- bitL 9y agoYou can always take tested ideas and apply to your own rig. The pioneering work was done by NVidia already, you see the results and it's up to you how much inspiration can you take from their work.
- JabavuAdams 9y agoThere are lots of sources for mocap data if you know people in the film, games, or entertainment industry.
- mkagenius 9y agoWe see a similar realtime application in snapchat[1] -- probably not as detailed as this one but might be a similar tech, 1. https://techcrunch.com/2015/09/15/snapchat-looksery/ https://techcrunch.com/2015/09/15/snapchat-looksery/
- yathern 9y agoI don't think there's any mention of NN to create those filters - in fact, not sure if it's ML at all. Very likely some off-the-shelf CV face-detection - especially considering it must run real-time on a phone.
- bitL 9y agoYou can trivially detect facial features using Deep Learning/CNN on a phone real-time. https://www.kaggle.com/c/facial-keypoints-detection https://www.kaggle.com/c/facial-keypoints-detection
- dr_zoidberg 9y agoEven the "simplest" face detection algorithms rely on strong machine learning concepts, eg: Viola-Jones uses AdaBoost to train the face classifier cascade.
- raverbashing 9y agoNot really http://docs.opencv.org/trunk/d7/d8b/tutorial_py_face_detection.html http://docs.opencv.org/trunk/d7/d8b/tutorial_py_face_detecti...
- dr_zoidberg 9y agoThe opening paragraph in that page literally says: "[...] It is a machine learning based approach where a cascade function is trained from a lot of positive and negative images. [...]"
- radarsat1 9y agoAmazing if they can manage to get this level of quality without requiring very special lighting conditions.