10 ms·
AI Model Fundamentally Cracks Captchas, Scientists Say
- habitue 9y agoI don't see how captchas are "fundamentally cracked" if they only claim a success rate at best around 2/3rds. Nor do they give an explanation for what they mean by fundamentally cracked.
- sobellian 9y agoA captcha is cracked if it becomes economical to try to pass it over and over again. If you have a script that succeeds in spamming a forum 2/3 times it tries, you've got a successful spamming system. What they mean by fundamentally cracked is that this method seems to be more robust against minor variations of spacing, font, etc. than CNN-based models.
- ComputerGuru 9y agoBefore you can say that a 66% success rate isn't good enough, you need to compare it to the human success rate. I barely get 2/3 myself.
- deleted 9y ago[deleted]
- a_imho 9y agoThis is my experience as well, very frustrating being locked out of your account when you need to take care of business. Nevermind cracked, they are fundamentally broken if a human can't get a nearly perfect success rate.
- willchang 9y agoCaptchas are useless for their intended purpose if a bot can get it right better than every other time.
- taesis 9y agoThis [1] is the article they're citing. Note that a cursory search turns up similar claims from back in 2013; it might be worth waiting for someone with more experience and less bias to express their opinions before dumping your captcha-related stocks. [1]: http://science.sciencemag.org/content/early/2017/10/26/science.aag2612.full http://science.sciencemag.org/content/early/2017/10/26/scien...
- thisisit 9y ago> captcha-related stocks. Are there companies relying only only selling captcha for revenues?
- taesis 9y agoshrug I was just cracking wise, but maybe? I've had the stock market on my mind a lot recently, hence the bad joke.
- sgustard 9y agoSure there are, I was an early investor in udbbGxls.
- linkmotif 9y agoYou must be rtEepkQq now!
- stepik777 9y agoThere are captcha farms in Asia where hundreds of people are sitting in the building and solve captchas non-stop.
- xkcd-sucks 9y agoMaybe captchas could be implemented as opinion polls re: tiananmen square or something
- trophycase 9y agoAt a certain point it will be impossible to create a working captcha. Are we basically engineering a Turing Test?
- taneq 9y agoCAPTCHA is literally meant to be an automated Turing test. It's right there in the name: "Completely Automated Public Turing test to tell Computers and Humans Apart"
- mitchty 9y agoSome of the captchas I get lately have honestly made me think I'm probably not a human as far too often I can't make heads or tails of the letters. At a certain point I just give up and refuse to use the worst sites that use this junk.
- SomeStupidPoint 9y agoI just assumed the test was that if you can decode that mess, clearly you're a bot.
- nabla9 9y agoCAPTCHA is Turing test with role reversal. Computers try to figure out who is human and who is not. In Turing test humans try to who is human and who is not.
- taneq 9y ago10 points to the first person to hack up a CAPTCHA using Winograd schemas.
- Filligree 9y agoWhy not cut out the middleman? Make the captcha be controlling a paperclip manufacturing device.
- stefanpie 9y agoThis comment is referring to this deceptively simplistic game: http://www.decisionproblem.com/paperclips/index2.html http://www.decisionproblem.com/paperclips/index2.html Trust me this is nothing but simple and will take you on a wild ride.
- DuskStar 9y agoAs good as that one is, and I do rather like the themes, it loses heavily in depth and complexity to Kittens Game. Universal Paperclips will take under a day to beat; Kittens Game will not fall so easily. https://bloodrizer.ru/games/kittens/ https://bloodrizer.ru/games/kittens/
- taneq 9y agoOh, I thought it was in reference to the Paperclip Optimizer referenced every now and then on lesswrong.com :S
- FeepingCreature 9y ago(It is, and so is that game.)
- taneq 9y agoOh, of course. Duh. :/
- deleted 9y ago
- HealthGoth 9y agoElon Musk and Mark Zuckerberg have both warned about the threat of AI and also invested in Vicarious. Vicarious announced they broke captchas 3 years ago, so presumably this is research from then. I wonder what they are up to now, and if it has any relation to why Elon has been especially vocal about dangerous AI recently
- vonnik 9y agoIs this the same old news from Vicarious? They announced this four years ago and raised about a $100M since then... http://www.slate.com/blogs/future_tense/2013/10/28/captcha_cracked_startup_vicarious_claims_artificial_intelligence_breakthrough.html http://www.slate.com/blogs/future_tense/2013/10/28/captcha_c... I thought the world moved on.
- gruez 9y agoIs there more to this than "text captchas can be broken by deep learning"?
- wheresmyusern 9y agoa lot of services use facebook to verify that someone is a human. there should be a service that exists only to manage peoples identities online. sign up, provide some id, an address and last four of your social. later, maybe a letter is sent to the address and returned with a verification code. then, every other service on the internet could use that service to prevent bots, spam and other things.
- pinum 9y agoI can foresee absolutely no potential problems with this plan...
- wheresmyusern 9y agothen what do you propose?
- lsseckman 9y agoAre you aware of the book The Circle?
- wheresmyusern 9y agodude what does that even have to do with this? identity will need to be taken care of in the absence of capcha, or else we will have an internet that cannot differentiate between a bot and a real person. think of all the websites and all the broad categories of websites that would be broken by that. is this not a problem in need of a solution?
- sitepodmatt 9y agoCentralized identification services, thinking of some names, how about Experian or Equifax
- wheresmyusern 9y agothose companies gathered tons of information without even asking people first. and why would this service require the sensitive information to be stored at all, let alone in plain text?
- reilly3000 9y agoSince when was captcha not broken? Sites like http://www.deathbycaptcha.com/user/order http://www.deathbycaptcha.com/user/order have been around for ages. Yes, a mere $6.95 gets you 5000 captchas solved by OCR and humans in an avg of 6 seconds. Imagine that job. Sure, AI can break captcha, but it can be done at scale for far less than an AI research and GPU rig costs. Google's approach to bot recognition is training their own bots incidentally, so even an adversarial network attempting to bypass it would give it a ton of training along the way to breaking in.
- notatoad 9y ago>Imagine that job. I don't believe it's a job. Isn't this the thing where captchas on target sites are simply mirrored on other sites like sketchy filehosts? Real human users are solving captchas to access some content hosted by this service, and the solution they enter is passed through to the target site.
- skgoa 9y agoYes, exactly this is the case.
- exikyut 9y agoCould you give me some pointers/hints (or even specific examples) where I'd find this in use? I ask because IIRC I've never seen ReCaptcha be used on file hosting sites. (I don't think so, at least. There might be one...)
- nnfy 9y agoAs scummy as it is, you have to admire the ingenuity. That is a damn clever solution.
- stepik777 9y agoThat's also how Google self-driving cars work. When they don't understand what they are seeing they just show pictures to some random person in Google captcha who solves it quickly.
- briga 9y agoI think rather than being broken, captcha models are just going to be made more complex. Maybe they'll start asking you to write a poem or play a mini problem solving game.
- taeric 9y agoI'd expect adversarial images to take off in captcha space. Don't try and avoid the models, exploit them.
- lozenge 9y agoAdversarial images need to be made with knowledge of the model.
- yorwba 9y agoActually, no [1]. From the abstract: We can cause the network to misclassify an image by applying a certain imperceptible perturbation, which is found by maximizing the network's prediction error. In addition, the specific nature of these perturbations is not a random artifact of learning: the same perturbation can cause a different network, that was trained on a different subset of the dataset, to misclassify the same input. [1] https://arxiv.org/abs/1312.6199 https://arxiv.org/abs/1312.6199 EDIT: Also interesting: "Universal Adversarial Perturbations" https://arxiv.org/abs/1610.08401 https://arxiv.org/abs/1610.08401
- partycoder 9y agoVicarious demoed cracking captchas at least 3 years ago. Dileep George, cofounder of Vicarious, is the former Numenta CTO, and claimed to use probabilistic graphical models as a basis for their tech. https://www.youtube.com/watch?v=-H185jPf-7o https://www.youtube.com/watch?v=-H185jPf-7o
- indubitable 9y agoSeems like natural language processing would be an interesting direction for captchas. - A man is running. A dog is behind him barking and growling. What does the man think might happen? - A man goes up the stairs to the roof. He walks to the very edge of the building. He takes one more step. What is the man trying to do? The correct answer should be pretty easy to parse out. And I'd expect a better success rate for humans than some of the captchas today that increasingly are looking more like magic eye puzzles than character recognition. But of course the big question is generation. Can these sort of implication based stories be generated in a way such that the final text can not trivially be reversed to the answer (without even considering the 'meaning' of the question)? And for that matter can these even be realistically generated in mass?
- dmead 9y agoYou're in a desert walking along the sand when all of a sudden you look down and see a tortise. You reach down and flip the tortise on it's back. The tortise lays on it's back, it's belly baking in the hot sun but you're not helping. Why is that leon?
- raverbashing 9y ago* Tortoise * its back * its belly * Leon (in case the mistakes were not for comedic effect)
- reacweb 9y agoOne of the fundamental problem with captchas is that writing a bot that defeat captchas is a very interesting exercise for teaching AI.
- falcor84 9y agoI always understood this to be a feature. Captchas seem to be used as public signposts for tasks that AIs are not yet good enough at. So, given the financial incentives on both sides, I'd like to believe that continually creating and overcoming these tasks is a possible route to AGI.
- _pdp_ 9y agoMany types of CAPTCHA systems can be defeated with machine learning models and OCR. Google provides its own called Google Vision API. Here is a brief example how this is done in practice: https://blog.websecurify.com/2017/10/cracking-captchas.html https://blog.websecurify.com/2017/10/cracking-captchas.html Perhaps this is an old news as this technique has been out for a while but I find that it is still relevant in the many cases I have encountered. Furthermore, in my experience, I attribute Google's failure to improve reCAPTCHA's "I am not a robot" visual appeal as one of the key factors why many organisations are simply not using it.
- Sir_Cmpwn 9y agoWhat's the human pass rate for captchas? I bet I've personally failed at least 20% of the captchas I've solved in my lifetime.