4 ms·
This is very interesting. Segmentation is a very, very hard problem and the video indicates they have made it fast. 4000 images is a lot and at 21GB per model t
by AndrewKemendo 11y ago
This is very interesting. Segmentation is a very, very hard problem and the video indicates they have made it fast. 4000 images is a lot and at 21GB per model the processing overhead has to be massive. 60-100 minutes is also a pretty long time to recover one model, but not crazy, and will certainly get faster.
I don't see any scale reference markers or other reference material in the scene, so I wonder if it recovers scale from light field depth information alone.
Interestingly from the paper, they aren't actually using a light field camera - but rather creating a light volume through sequentially varying the depth of image taken and modeling the volume:
Key to our method is the dense spatio-angular sampling of video, which results in smoothly varying parallax between successive frames
A hack for sure!
I would be curious to know if using a light field camera would even be useful in this scenario as much of what they do mimics the light field camera processes, only manually.