3 ms·
They appear to be using blender to generate data for machine learning! So if you want to be able to recognizes poses or hand gestures from video or image still
by DrScientist 6y ago
They appear to be using blender to generate data for machine learning!
So if you want to be able to recognizes poses or hand gestures from video or image stills, you need data to train your network.
The bottleneck is often high quality 'labelled' data - real data that requires people to laboriously label each frame and region with the 'ground truth'.
However, if you automatically generate the poses using something like Blender, you can also automatically label, and also generate a huge variety of systematic variations in camera angles, lighting, levels of noise etc.
Obviously there might be a worry that the Blender generated images may somehow inject their own bias, but they claim it's working really well.
https://www.microsoft.com/en-us/research/uploads/prod/2019/09/2019-10-01-Synthetic-Data-with-Digital-Humans.pdf https://www.microsoft.com/en-us/research/uploads/prod/2019/0...
- m12k 6y agoReminds me of how the first version of AlphaGo used recorded games played by humans, but later versions were able to surpass that using self-play.
- nightcracker 6y agoFor the final project of the multimedia information retrieval class in my CS Master's I'm doing something similar. The goal is to predict depth maps from single-view pictures using CNNs. But how to gather input, output pairs to train them? I'm using a mod for Minecraft I wrote to generate such labeled data, e.g. input: https://i.imgur.com/JRtmCeG.png https://i.imgur.com/JRtmCeG.png output: https://i.imgur.com/q4KocXn.png https://i.imgur.com/q4KocXn.png. I'm not done yet so I can't tell you the results, but it's a fun project.