17 ms·
Facebook open-sources Detectron
- newscracker 9y agoThis looks amazing from the computing point of view (and is an achievement of sorts), yet the confidence percentages are lower than what an average human might be able to solve for (like in the case of CAPTCHA tests). Meanwhile, I wonder about the human costs if systems like these are adopted for purposes where they may be ill suited for, especially cases where their confidence scores are ignored (or mistakenly assumed to be 100% even when they're lower). Anyone have reading material on this?
- notyourwork 9y agoCare to give any examples of scenarios you are concerned about?
- newscracker 9y agoMy primary worry is law enforcement and government surveillance considering these systems as infallible and making judgments or life-changing decisions based on interpretations like this from computers. Computing has improved our lives a lot, but sometimes I feel there's an air of over confidence that clouds our judgment.
- drdrey 9y ago> Beyond research, a number of Facebook teams use this platform to train custom models for a variety of applications including augmented reality and community integrity. Any idea what they mean by "community integrity"?
- readams 9y agodetecting porn, presumably.
- adventured 9y agoI would expect it to work on detecting the mismatching of content for types of communities in general. For example, preventing pictures of cats or giraffes being uploaded as a product photo on Poshmark when it's supposed to be a pair of shoes. That type of check should become standard in a short amount of time for all communities that accept photos (that isn't meant to be general purpose, eg Imgur).
- m_ke 9y agoA few craigslist competitors are using CV to detect drugs/weapons/animals.
- schrep 9y agoFor example marketplace (where you can sell items on Facebook) will suggest a category for the item if you upload a photo.
- paulie_a 9y agoI can't wait for Facebook marketplace to fail. The constant stream of useless ads is obnoxious. I am using Facebook less because there is no way to block that low quality content
- hultner 9y agoWhen could counterfeits be detected with a somewhat decent accuracy? Is it something that has been attempted? I checked out Facebook Marketplace a few times since the launch and and everytime I'm just overwhelmed by the sheer amount of better or worse counterfeits. On top of that I start getting notifications more counterfeits, for a short while I reported them but after a while it felt pointless and now I just ignore the marketplace tab.
- deleted 9y ago[deleted]
- eb0la 9y agoMaybe you want to censor internally part of an image for privacy reasons. For instance, in my country you cannot use or publish children images without parents consent. The fine for doing that is way higher than your benefits even discounting bad press.
- drdrey 9y agoWhat country is that?
- tomschlick 9y agoHotdog / Not Hotdog
- xiphias 9y agoI'm happy that tech companies are open sourcing basic research all the time, and thinking a lot about what would have happened if large pharmacy companies did the same thing. I'm just hopeful that with new biotech companies the science behind curing people will get faster as well.
- ejstronge 9y agoUnlike the case in tech, pharma basic research is far less important in advancing our knowledge when compared to academia. A good example comes from the last few blockbuster cancer therapies - CAR-T cells and checkpoint blockade all arose in academic labs. Also, for drugs that do make it to market, efficacy and side effect information is published as a condition of drug approval, at least for new drugs. Whether basic science research papers should be behind a paywall is a wholly separate issue, but the life science community largely shares its finished products. Indeed, there’s even a push to share early stage data, too.
- xiphias 9y agoThanks, this is the kind of answer I was looking for. It's just a bit sad that the companies rely so heavily on academia. About the papers on efficacy: I remember that I wanted to slice the efficacy data to customize it more to compute confidence intervals for my ex girlfriend's case who has breast cancer (BRCA2), but she didn't want to have hemotherapy and wanted to see if the drug can help in that case as well, but the raw data in the testing wasn't published.
- fjsolwmv 9y agoCode is cheap. Training data is expensive
- shitals 9y agoNot if you have simulator :) https://github.com/microsoft/airsim https://github.com/microsoft/airsim
- fulafel 9y ago
- evmar 9y agoAlso noteworthy: the Apache 2 license, which includes a patent grant (unlike the previous Facebook licenses that have caused concern in the past).
- haeffin 9y agocaffe2 (which this is built on) was switched from bsd+patents to Apache2 a while ago too.
- zitterbewegung 9y agoI think if either a project that FB uses upstream has Apache 2 or if you are a large organization (for example the Apache Software Foundation) you can use your clout to force Facebook to use Apache.
- traek 9y agoCaffe2 is a Facebook project, so they’re not exactly being “forced” to release it or any downstream projects under Apache 2.
- megous 9y agoSo is this the end of Google captchas asking for where the car/sign/whatever is? Will there be a final battle of AIs, where they will kill each other, and the unfettered access to websites over VPN/tor wins and laughs the last laugh?
- schrep 9y agoThis is some of the most advanced work out there - but CV is not “solved” most vision systems only can label about 1k categories of objects. So capatchas can still be easiy constructed that would fool these systems. Part of why it is exciting to get this out there others can help us improve it.
- m_ke 9y agoImagenet is the only reason why most models are trained on 1K of categories. There's plenty of models in the wild that handle 10s of thousands of classes.
- schrep 9y agoWith what precision and recall?
- m_ke 9y agoNot that much worse than what you see on imagenet. Most large companies have internal datasets with >100 million images. https://arxiv.org/abs/1610.02357 https://arxiv.org/abs/1610.02357
- schrep 9y agoThat’s impressive work. Still don’t think we have reached human level for all the categories of things we see in images. But you are correct that my comment about 1k categories is not true for many production systems.
- stmw 9y agoThis is great! I do wish this were written in something other than Python. What is the carbon footprint of all this computer vision, compute-intensive code still being run billions of times a day in Python? Someone should calculate...
- minimaxir 9y agoThe actual computationally-hard part of the code is run in the GPU using CUDA.
- inlined 9y agoWhat was the carbon footprint of the turk machines the Python can replace?
- stmw 9y agoare you seriously comparing inefficient python code to humans?
- croon 9y agoIf you choose to measure something in simply one dimension, don't be surprised (offended?) when someone else builds on your premise. Humans are objectively terrible for the environment. Now you might start to argue other metrics instead, or that on an nth removed degree it/we might result in a net positive, but then you've abandoned your initial premise anyways.
- stmw 9y agoIt is funny to see this comment get "-4" already... What's so offensive? After all, Facebook has rocksdb in C++, percona in java, and a PHP->C++ compiler, so they clearly have both the belief and the skill in moving away from interpreted programming languages for performance-sensitive code.
- linkmotif 9y agoFor some reason, people are offended by gross misunderstandings. This framework is in Python, but it’s a Python binding that sets up code that runs natively (not even sure the details myself; others are writing CUDA). TensorFlow is the same way. It’s in Python, but the computations are not in Python. As you point out, that wouldn’t make sense.
- franciscop 9y agoDoes anyone know an alternative that works on RaspberryPi? This states: "Detectron operators currently do not have CPU implementation; a GPU system is required." Even low FPS (3-5) would be acceptable.
- m_ke 9y agoYou could try tensorflow object_detection api with tensorflow lite https://github.com/tensorflow/models/tree/master/research/object_detection https://github.com/tensorflow/models/tree/master/research/ob... google also recently put up their mobilenet v2 paper which handles segmentation https://arxiv.org/abs/1801.04381 https://arxiv.org/abs/1801.04381
- pilooch 9y agoSee https://github.com/jolibrain/dd_performances https://github.com/jolibrain/dd_performances you can reach 1fps on image classification and objects detection tasks on rpie3 with custom caffe and models.
- haeffin 9y agoIt's a bit disappointing, when caffe2 was released it was stated that mobile is a big focus, but things like this don't support mobile (even though some of this was demoed by FB on a phone).
- ajtulloch 9y ago
- deleted 9y ago[deleted]
- yters 9y agoIs there a class of math problem humans can solve but computers cannot? Then we could just use these problems as a guaranteed test instead of the current CAPTCHA arms race.
- m_ke 9y agoThere is no arms race. 99.9% of the time Google knows if you're a robot based on your browser state. They make you label the images because it's a free way to get training data.
- ftoo 9y agoHow does that work? Could we create an open source lib to replace Recaptcha?
- kuschku 9y agoGoogle has basically your entire browsing history, and search history. Google then compares that with what is considered normal for a human, and then lets you in if you pass that check. Of course, if you run IRC bots that scrape Google with a headless browser to implement a .search functionality, and which offer link titling in IRC, and you use a separate bucket of cookies and IP for every IRC bot, your bots now also have a human search and browsing history, and also will pass all ReCaptchas...
- paulie_a 9y agoThen why does Google use the world's worst captcha for their own services?
- gldalmaso 9y agoI see this argument a lot and considered it the case to, but I have to wonder if that really is the case. Wouldn't google be empowering people to really mess up their training data? If I'm trying to automate a system to fool their captcha, I'm probably getting a lot of bad results. Or I could just be intentionally feeding them bad data, the fact that not being allowed through captcha keeps letting me make more and more inputs would enable someone to do that as long as they would like to. I don't know, maybe I'm missing something.
- JepZ 9y agoAnybody knows a way to run CUDA programs with the open source driver (nouveau)?
- yorwba 9y agoCUDA needs driver support to talk to the GPU, and since it is proprietary nVidia technology, the open-source driver can't support it. So either you run the nVidia driver or you have to use OpenCL.
- skate22 9y agoI had to specifically disable nouveau to get cuda to install correctly on ubuntu 16.04. You need an nvidia card and drivers that are new enough to run the later versions of cuda.
- alhafizco 9y agohttps://pbckuwait.com/Food/mitchells-all-products https://pbckuwait.com/Food/mitchells-all-products
- wazoox 9y agoThis is relying on proprietary CUDA technology. This doesn't qualify as Free Software to me.
- zer0t3ch 9y agoWho said it was Free Software?
- candlefather 9y agoReminds me of this pic from Terminator https://s3.amazonaws.com/pbblogassets/uploads/2015/08/Terminator-POV.jpg https://s3.amazonaws.com/pbblogassets/uploads/2015/08/Termin...
- yohann305 9y agomy overall feeling as someone that wants to start getting into visual recognition is that there are a bunch of great libraries/ecosystems to choose from and all of them have pros and cons, but i honestly don't want to make the wrong decision and end up being stuck later on. Anyone here has any advise on what i should use to have a camera(rpi) recognize most common objects and then add a layer where we can teach specific objects, ie (putting a name on a person or a pet), thank you!
- 2bitencryption 9y agounless I'm mistaken, this is the very first lesson of the fast.ai course.
- apendleton 9y agoThe first lesson is image classification ("is this a picture of a cat or a dog?"). Given that OP is commenting on an object detection library release, though, I assume they're interested in object recognition/detection/segmentation and rather than just image classification. So, more like: "what things are in this image and where are they?" or even just "where are the dogs in this image?" That's also covered eventually in fast.ai, but not until the second course if memory serves.
- dapreja 9y agoYou should be set with openCV or JavaCV. JavaCV has more ported image/video progressing libraries than openCV and are a bit more customizable in my experience. And literally JavaCV has openCV natively but a different wrapper. I would only suggest openCV if you are working with python. It provides enough tools for basic then mid complex objects and if you want to mature in it then open up the hood. As for porting that pet porject to a mobile android device i would suggest to go straight with javaCV even though openCV has wrappers for android and java. The reason is because at some point you'll want to ditch their riggid methods of obtaining video/pictures. JavaCV has served me well when integrating with android. Also, if you eventually want to scale up the processing into a web service then it' easier.
- fnbr 9y ago
- gimmeayrwlt 9y agoIs anybody really interested of facebook or they technology anymore ??
- ibdf 9y agoI was just looking into trying out YOLO. Does anyone know how both compare?
- aaroninsf 9y agoCan someone with GPUs and love in their hearts, bundle this with trained models in a Docker container? (serious request... I got a cluster, and something like a million pictures; but no GPUs or time for another side project...)
- burningion 9y agoI’ve started working on this, it seems the current Dockerfile for caffe2 doesn’t work out of the box because of a forced push. Follow me on Twitter, and I’ll post it there when it’s finished. Same username as here. * edit: I've put a pull request in that builds the Dockerfile for the GPU for now: https://github.com/facebookresearch/Detectron/pull/15 https://github.com/facebookresearch/Detectron/pull/15