6 ms·
OpenPose: Real-time multi-person body, face, and hands estimation
- m12k 9y agoThis looks promising. Any thoughts on the license?
- wiz21c 9y agono commercial use it seems. Not 100% related, but the copyright holder(s) are not clear. There is a list of authors so I'd bet they are the copyright holders. But given the fact their email addresses somewhat point to CMU, I wonder if CMU is behind...
- mcsb1 9y agoThe Github account is from CMU perceptional computing lab. Thus I'd consider it reasonable to assume that CMU is behind.
- wiz21c 9y agoI don't know CMU well, is it privately hold ? I really wonder if the work we see here was paid by taxpayers' money. I guess the papers are freely available but the implementation is not.
- claforte 9y agoI'd say it would cost 5% royalty on sales assuming that algorithm was key. Ten years ago I negotiated a licencing agreement with CMU for a computer vision algorithm. I was leading an unknown startup. 5% with no upfront fee is what we ended at.
- electricslpnsld 9y agoThe PI on this project (Yaser Sheikh) also heads up Oculus' Pittsburgh lab. Not sure if there is any overlap on this project.
- zanalyzer 9y agoThe prof is also associated with oculus/fb, so the license has to be friendly to them as well.
- seeekr 9y agoThere's actually a link somewhere to a page[0] that, all the way at the bottom states the price as USD$25,000 for a "Commercial License, yearly renewal". [0] https://flintbox.com/public/project/47343/ https://flintbox.com/public/project/47343/
- kejaed 9y agoWhen I saw this a little while ago I thought it would be great for automated video analysis of barbell lifts / weightlifting given the angles involved in such things can be a good metric for form. However, the license specifically states that you cannot use it for sports. I wonder if they singed a high value exclusivity agreement with someone in that space, or if some such company funded the research originally... "The non-exclusive commercial license cannot be used in the field of Sports. ("Sports" shall mean any and all athletic competition between individuals, groups of individuals or teams.)"
- SiempreViernes 9y ago"You agree that all and any such derivatives and modifications will be owned by Licensor" Assigning ownership of your own modifications to them seems significantly stronger than forbidding redistribution of your modified version. With this, just getting the examples to run on your own machine is effectively free development for the authors.
- Chris2048 9y agoIs that legal? You can claim ownership of derivatives??
- thecatspaw 9y agoSure, you can claim anything. IANAL, but I don't see why this would not hold up. It is their code, its in their license agreement (which is a contract you agree to). If you do not wish to give them the rights to your modifications, the license forbids you from using it
- Chris2048 9y agoSure, but I was of the impression that they can only control rights to use their software, not claim your own - I'm not sure if "which is a contract you agree to" is true if nothing is signed. Note: by reading this notice you agree that all that is yours is mine, and all that is mine is mine also. ;-)
- thecatspaw 9y agoYour note does not work because I am not agreeing to anything. You either are agreeing to the license implicitly by using the product, or you are not allowed to use it (and would therefore use code which you dont have a license to)
- mottosso 9y agoIf you read the message, you agreed to the terms. If you didn't read it, then how can you comment on what it says? :)
- 0xfaded 9y agoPaper https://arxiv.org/pdf/1611.08050.pdf https://arxiv.org/pdf/1611.08050.pdf TLDR; convnet for joint localization, old school optimization techniques (graph coloring, etc) to put the pieces back together. Re license, I don’t at all mind research being commercialized, but the use of “open” in the name rubs me the wrong way. Who in their right mind would work on this? At best it will become a benchmark to compare other systems against. The FSF requires a snail mail letter for copyright assignment. I don’t know the specifics, but this suggests magical auto-assign copyright clauses may not hold up. Personally I GPL my stuff that may be commercially valuable. It allows a community to maintain an open version and produce offshoots, while you maintain your own version with only code you wrote for licensing.
- sandGorgon 9y agoThe training data comes from >Check https://github.com/ZheC/Realtime_Multi-Person_Pose_Estimation https://github.com/ZheC/Realtime_Multi-Person_Pose_Estimatio... for training questions. We are using their model. https://github.com/CMU-Perceptual-Computing-Lab/openpose/issues/47 https://github.com/CMU-Perceptual-Computing-Lab/openpose/iss... What is the difference between this one and the other one ?
- VikingCoder 9y agoHow does it do on modern dance? https://www.youtube.com/watch?v=FOZ6KnVPvIU https://www.youtube.com/watch?v=FOZ6KnVPvIU
- lettergram 9y agoHow does this compare with just calling all the OpenCV functions in parallel then merging? It kinda seems like what they did, which if it works - then kudos, but the licensing should be easy to avoid then.
- svantana 9y agoErrr, what? This project uses huge neural nets for detection, nothing like that is available in OpenCV. I think they only use OpenCV for IO (accessing webcams etc).
- anc84 9y agoWhat a disgrace to the "Open" prefix. Guess we need a FreeAndOpenPose instead...
- grondilu 9y agoCouldn't this be used to automatize fire weapon aiming? Or worse : a laser beam aiming automatically to the eyes. It'd be quite bad since it'd be cheap and unlike fire weapons, lasers are easy to build or acquire. How long until a mass shooting uses such technology?
- shezi 9y agoRealistically, if you wanted to do such a thing, you could have used a Kinect for a long time. Even face detection would work in your example, and we've had robust and cheap detection for a long time. So I assume that this is a movie-plot threat. However, for a dramatic interpretation of your query, I suggest "Daemon" and "Freedom TM" by Daniel Suarez. The book shows groups using these technologies to great effect.
- swframe2 9y agoI like OpenPose. This area is progressing so quickly. DensePose was published recently: http://densepose.org/ http://densepose.org/ End-to-end Pose was published late last year: https://akanazawa.github.io/hmr/ https://akanazawa.github.io/hmr/
- m1sta_ 9y agoAt a very high level how do they differ?
- swframe2 9y agoAll of them take 2d images of humans: open pose -> 2d points of major parts. (generation of 3d points is under development) end-to-end pose-> 3d mesh of human body dense pose -> 2d uv maps that can be placed on a 3d mesh I should also mention: AutoHair -> 3d mesh of hair from 2d image http://gaps-zju.org/autohair/ http://gaps-zju.org/autohair/ ClothCap -> 4d cloth transfer to different 3d human model (this one doesn't do "2d image to 3d cloth" but probably something that can be done starting with ClothCap) Face -> 3d mesh of face https://github.com/AaronJackson/vrn https://github.com/AaronJackson/vrn
- scoot 9y agoGiven two views of the same scene, could the output of something like (NotActuallyOpen)Pose theoretically be combined to create a marker-less 3D motion tracking solution?