8 ms·
MODNet: Is a Green Screen Necessary for Real-Time Human Matting?
- FredFS456 6y agoI'm sure it's great, but we'll have to wait for the source/demo/pretrained model to really tell.
- m00dy 6y agoGenerally speaking, reproducibility in research is not the main concern.
- nuclearnice1 6y agoProposed timeline from GitHub: > We first plan to publish an online image/video matting demo along with the pre-trained model in Dec. 2020. We then plan to release the code of supervised training and unsupervised SOC in Jan. 2021. We finally plan to open source the PHM-100 validation benchmark in Feb. 2021.
- gfodor 6y agoThis sounds awesome so don't take my comment as a criticism, but it is interesting that it highlights a difference between academics and non-academics - academics often publish papers before code, whereas non-academics/hackers publish code, and then probably never get around to writing the documentation :)
- iamtedd 6y agoMaybe if we can get the academics and hackers to perform some human matting.. [reference to comments about misreading the title]
- roel_v 6y agoI think the linked Youtube demo video is pretty impressive, compared to what I see in most video conferencing software.
- wheybags 6y agoI can't be the only one who read this as mating
- Al-Khwarizmi 6y agoYou aren't. In fact, as a non-native, it's difficult to not misread, as I didn't even know what matting was. And "real-time" and "human" go perfectly well with mating.
- emsy 6y agoSame hear, I call them Freudian misreads.
- coldtea 6y agoIt would be Freudian if there was some subconscious tendency at play to misread it. But here even though "mating" is sexual, the misread is quite easy and effortless because the word "matting" is an obscure industry term that looks totally like "mating"....
- TeMPOraL 6y agoCould be tiredness as well. When I saw the headline on the front page earlier, I read the word correctly. When I alt+tabbed to it just now, being tired, I did a double take because I read it as "mating".
- johnchristopher 6y agoIn french language we have the "lapsus révélateur" catch phrase to call such slips.
- cbanek 6y agoAnd here I read it as meeting. I'm glad I'm on vacation, but next week is the week of meetings...
- jacobush 6y ago
- crazygringo 6y agoI wonder how this compares to remove.bg [1] (for images) and unscreen.com [2] (for video)? [1] https://www.remove.bg/ https://www.remove.bg/ [2] https://www.unscreen.com/ https://www.unscreen.com/
- interestica 6y agoHistory/Context: How Green Screen Worked Before Computers https://www.youtube.com/watch?v=msPCQgRPPjI https://www.youtube.com/watch?v=msPCQgRPPjI Hollywood's History of Faking It | The Evolution of Greenscreen Compositing https://www.youtube.com/watch?v=H8aoUXjSfsI https://www.youtube.com/watch?v=H8aoUXjSfsI Zoran Perisic's 'Zoptic' front-projection system used in Superman: The Movie https://www.fxphd.com/fxblog/effects-of-days-past-making-superman-fly/ https://www.fxphd.com/fxblog/effects-of-days-past-making-sup... https://www.youtube.com/watch?v=mbXC16p8tNc https://www.youtube.com/watch?v=mbXC16p8tNc The technology that’s replacing the green screen https://www.youtube.com/watch?v=8yNkBic7GfI https://www.youtube.com/watch?v=8yNkBic7GfI Mandalorian 'Stagecraft' technology https://www.slashfilm.com/the-mandalorian-stagecraft-photos/ https://www.slashfilm.com/the-mandalorian-stagecraft-photos/
- homarp 6y agosome more context: This research is done by SenseTime Labs and CityU of Hong Kong HN discussion on SenseTime: https://news.ycombinator.com/item?id=17196704 https://news.ycombinator.com/item?id=17196704 see also https://qz.com/1248493/sensetime-the-billion-dollar-alibaba-backed-ai-company-thats-quietly-watching-everyone-in-china/ https://qz.com/1248493/sensetime-the-billion-dollar-alibaba-... and MIT partnership - https://news.mit.edu/2018/mit-sensetime-announce-effort-advance-artificial-intelligence-research-0228 https://news.mit.edu/2018/mit-sensetime-announce-effort-adva... they were also on the Trade blacklist last year - https://news.ycombinator.com/item?id=21195107 https://news.ycombinator.com/item?id=21195107 Interesting paper: "Eliminating Background-bias for Robust Person Re-identification" - https://openaccess.thecvf.com/content_cvpr_2018/papers/Tian_Eliminating_Background-Bias_for_CVPR_2018_paper.pdf https://openaccess.thecvf.com/content_cvpr_2018/papers/Tian_...
- gdubs 6y agoThese are great — particularly that first link. What a great explainer.
- virtualritz 6y ago> The technology that’s replacing the green screen [...] This is only replacing matting (which includes blue screen) in a very specific type of photography for now. Namely when the background is out of focus.
- rozab 6y agoI mean, cool, but I was expecting code when I clicked on a GitHub link. Maybe would be better to just link to the preprint instead
- gabereiser 6y agoSame. A github link kinda assumes a repo of code to poke at.
- deleted 6y ago[deleted]
- rsync 6y agoMatting not mating ... Matting ...
- deleted 6y ago[deleted]
- BerSerKer 6y agoThis reminded me a lot of this study: https://github.com/senguptaumd/Background-Matting https://github.com/senguptaumd/Background-Matting
- villgax 6y agoThe real problem is not having first party solution to use our damn phones as webcams across PCs/Macs natively, without resorting to flaking IP cam software or virtual loopback devices which are laggy if they work.
- HMH 6y agoI agree! Recently I have been wondering if there is any reason why for example Android devices with a camera don't implement the USB video class specification, except for the reason that nobody cared enough.
- kyriakos 6y agoEven low end android phones take selfie video of way better quality than any built in laptop Web cam I've had experience with. Also unless you spend 200eu for the top end cams you won't get near that quality. At 200eu you can actually get a pretty decent mobile phone like oneplus nord which also has a decebt camera.
- wongarsu 6y agoIf you want to transmit the camera stream wirelessly in real time that effectively makes the phone an IP cam, with all the flakiness that often entails. It's not an easy problem. I'm also not quite sure which problem is being solved by using your phone as a webcam. Actual webcams are quite cheap and come with way better mounting hardware than your phone. And for freehand videos like in the paper the realtime requirement isn't very common, and if it's there it's usually sufficient to do the processing on the phone and stream directly from there. There has to be something I'm not seeing?
- donaltroddyn 6y agoPart of it is that webcams are nearly impossible to buy since the pandemic arose, but apart from that, webcam image quality is terrible - even expensive webcams in the price range of ~100's of Euro. A recent iPhone will wipe the floor with any webcam I've come across, short of an SLR or mirrorless camera.
- villgax 6y agoAlso there is no code, so posting the GitHub link right now is moot.
- deleted 6y ago[deleted]
- dheera 6y agoThere is no code in this repo. Would much rather this be posted when there is something to actually test.
- codezero 6y agoMaybe someone here will know this: are there similar things for artificial backgrounds that fit with my face and body position?
- ficklepickle 6y agoSince there is no code here, here is another repo: https://github.com/fangfufu/Linux-Fake-Background-Webcam https://github.com/fangfufu/Linux-Fake-Background-Webcam I haven't tried it yet, but it supports nvidia GPUs or CPU.
- 6gvONxR4sf7o 6y ago> We then plan to release the code of supervised training and unsupervised SOC in Jan. 2021. God, I’m so jaded on these promises these days. I hate looking back at old papers that promised to make their stuff available, but never did.