10 ms·
So is this the end of Google captchas asking for where the car/sign/whatever is? Will there be a final battle of AIs, where they will kill each other, and the u
by megous 9y ago
So is this the end of Google captchas asking for where the car/sign/whatever is? Will there be a final battle of AIs, where they will kill each other, and the unfettered access to websites over VPN/tor wins and laughs the last laugh?
- schrep 9y agoThis is some of the most advanced work out there - but CV is not “solved” most vision systems only can label about 1k categories of objects. So capatchas can still be easiy constructed that would fool these systems. Part of why it is exciting to get this out there others can help us improve it.
- m_ke 9y agoImagenet is the only reason why most models are trained on 1K of categories. There's plenty of models in the wild that handle 10s of thousands of classes.
- schrep 9y agoWith what precision and recall?
- m_ke 9y agoNot that much worse than what you see on imagenet. Most large companies have internal datasets with >100 million images. https://arxiv.org/abs/1610.02357 https://arxiv.org/abs/1610.02357
- schrep 9y agoThat’s impressive work. Still don’t think we have reached human level for all the categories of things we see in images. But you are correct that my comment about 1k categories is not true for many production systems.
- m_ke 9y agoDefinitely not close to having things work for all categories. As you scale up to more categories ambiguity and specificity becomes an issue. Clarifai has a nice demo of their model which has >10K classes, https://clarifai.com/demo https://clarifai.com/demo , the top predictions are usually correct but not always the most relevant. I only linked to the xception paper because it mentions JFT. It's not state of the art for large scale recognition.
- visarga 9y agoIt's not just a matter of detecting objects and locating them. The deeper computer vision problem is to identify object attributes, relations between objects and actions in video. It's much harder to do that because many relations appear in very diverse situations, with objects of different categories, so it's hard to have 1000's of examples for each class of relation. For example, humans can identify a monkey riding a Segway on the airport runway, but there probably is no such thing in the training set, even if it is quite large. The neural net might not know if that constitutes a "riding" action because it has never seen such a combination. Maybe the monkey is jumping over the thing and the picture shows it in proximity to it, not riding it - a human would know that a slight gap means there is no riding taking place. Then, the even harder problem is to predict the consequences of actions on objects and just to physically simulate the scene. Such knowledge is useful in robot action planning. Beyond computer vision, there is also a need to create a "mental simulator" that has theory of mind and can simulate other agents (what humans intend), and we need simulators, both physical and mental to create the next level of AI.
- humanbot 9y agoInteresting. Can you teach me what is the state of the art for large scale recognition? Would like to read more about it. Thank you.
- adrianN 9y agoYou don't need human level to make CAPTCHAs useless. If you can break the CAPTCHA 10% of the time that's already enough.
- 9y ago
- itsa2 9y agoIn case you didn't realize, the guy you're talking to is the CTO of what some may call a "large company."
- m_ke 9y agoWow that's a great catch.
- schrep 9y agoDoesn’t mean I’m right :) - see above as he had a point.
- mcintyre1994 9y agoAssuming from context you're CTO of Facebook, the facebook.com/schrep link in your profile isn't working: This page isn't available. The link you followed may be broken, or the page may have been removed.
- Kiro 9y agoIt works for me.
- spyder 9y agoThe link only works if you are logged in, otherwise it says the page not found, which is wrong message because it makes you think it doesn't exists even if you login.
- mcintyre1994 9y agoWorked when I logged in, thanks :)
- tvmalsv 9y agoAnd I enjoyed the conversation between two people that obviously know the field pretty well.
- dx034 9y agoBut how many more classes can all users solve? If you have to identify all oaks from a group of trees I doubt many would solve that correctly.
- dokument 9y agoAmazon will have a new captcha asking how many boxes of cheeze-itz this person is holding on their way out of a store.
- jamesmcintyre 9y agoI get it. lol
- vinniejames 9y agoNo, they are like using that data to build self driving car algorithms. I would imagine that's why it's always asking you to detect roadsigns
- deleted 9y ago[deleted]
- narrator 9y agoThe future is going to be your corporation/country/blockchain's AI vs your adversary's corporation/country/blockchain's AI with vast numbers of humans in the middle of the whole sh*tstorm just trying to survive and live a tolerable life.
- visarga 9y agoThat's good, though, I wouldn't want a future where a single AI has all the power. We need a multitude of AIs to increase equality for humans and diversity for AI.
- kbenson 9y agoGoogle doesn't even show a catpcha if they have enough tracking info for toy to verify you're a human, which is pretty simple for them if you don't clear all your cookies for a few days. I'm pretty sure Google thinks if they have to show you a catpcha they've failed, but along with that they don't feel the need to make the catpchas particularly easy if they do have to show it.
- deleted 9y ago[deleted]
- culerawo 9y agoExcept when it doesn't. Every so often it suddenly spams one with sheer number of captcha on sites that use the Google's Recaptcha API. Then you have to solve detect the houses, cars, store-fronts, deceiver plates and street signs several times successfully to move on or be prepared to solve several more captches to be allowed to move on. I would wish Google fix Recaptcha. It used to be so good.
- beobab 9y agoI hate it when I fail the Turing test, and can't log in to stuff.
- jacobush 9y agoIt doesn't seem to matter which images I click, it lets me in after a while anyway.
- culerawo 9y agoObviously I am 99.99% sure I am clicking correctly, yet Recaptcha displays me another and another captcha, until it lets me move on. Is it a system bug or maybe their bot detection got quite unreliable?
- lotsofcows 9y agoNeither. When Google finds someone willing to train its AI for free, it likes to take advantage.
- jraph 9y agoHas someone ever tried to submit images from Google captchas to Google Images? An answer like "This is definitely a sign" from Google Images would be funny.
- Jaruzel 9y agoI just tried it: http://www.jaruzel.com/files/streetsign.jpg http://www.jaruzel.com/files/streetsign.jpg :)
- nannal 9y agoYour SSL cert is for the wrong domain.
- Jaruzel 9y agoYour https-everywhere is doing it wrong. I don't have an SSL on my personal site (no requirement to). I do have SSL on other domains that share that IP however.
- Spare_account 9y agoI'm not expert on this but what I'm seeing is that port 443 is serving up a response when jaruzel.com is requested on that port. While you may not be actively advertising that domain with https URLs, it is valid for clients to request one speculatively. There isn't a valid cert for that domain and for some reason for server is offering a different one. Presumably you need to unbind 443 from that host header name (this is based on memories of configuring IIS a decade ago).
- na85 9y agoComplaining about a non-existent SSL cert and then backseat driving the "fix", using words like "you need to", all based on shady memories of configuring IIS a decade ago? Really?
- kurtisc 9y agoFor the car captchas, I've found actually clicking all the boxes with part of a car will always be a wrong answer (distinct from when it just makes you answer twice). Instead, you have to click on the squares that you know it thinks are cars. This creates a twisted Turing test situation where, to prove you are a human, you have to pretend to be a machine's idea of what a human is.
- js8 9y agoThat was my experience with car and sign captchas as well.. But interestingly, it also depends on my mood, when I feel lazy, I click fewer boxes.
- pbhjpbhj 9y agoThe problem with the cars for me is their definition -- is that van classed as a car, how about the half-back, what about a 4x4, what about a 4x4 with no back windows, ...
- indigochill 9y agoWhat about a square that contains just a sliver of the car from the next box over? Does that still count? I hypothesize that my attempt to classify every pixel related to a car as a "car" may contribute to my failing of these tests.
- toyg 9y agoThis is what kurtisc is saying. The algorithm is unable to classify those pixels, so you have to guess which bits of the car can be detected by the algorithm and then select only those. So you have machines asking humans to think like a machine in order to prove they are human.
- zer0t3ch 9y agoIsn't it supposed to learn from you? IE, answering technically correctly but what it thinks is incorrect is slightly annoying for you, but better for the system in the long run. (ie better for everyone)
- asfdsfggtfd 9y agoMore likely websites will just block Tor exit nodes + whole swaths of IP space (i.e. all AWS+GCP+Azur+DO etc IPs).
- freeflight 9y agoYup, this seems to be a pretty big factor. When I use a VPN to surf the web I'm usually stuck in captcha hell for the most simple and mundane things.