10 ms·

I’m not a human: Breaking the Google reCAPTCHA [pdf]

166 points by louis-paul 11y ago

sotrueee 11y ago
You could also just pay a service that uses human workers in third world counties. It's a little over a tenth of a cent per captcha.
- davedx 11y ago
  Not so economical if you want to brute force a login page.
- amelius 11y ago
  Or you could set up a pr0n site that shows the material only after the user has completed the captcha. This trick has been done before.
  - dspillett 11y ago
    I've never seen a documented case of such tricks actually being used, and I've seen calculations that suggest the cost/benefit outcome is no better than just paying the poor to do the menial work. The last such analysis I paid attention to was some years ago so the situation may have changed, but I suspect the hassles of running a porn site and CAPCHA proxy still aren't worth it: * obtaining content sufficient to attract interest * paying for bandwidth & other resources) * writing the authentication system * then maintaining it (every time the CAPCHA service(s) change their process you potentially need to make and test changes to your code) * and you need to work around rate limits (depending on the CAPCH design it may not be possible to make the relevant requests client-side so if the services has rate limits you'll have to route through something that sufficiently randomises your source address). * providing support * dealing with bad press
    - ErrantX 11y ago
      And also, if you got to the point where that porn site was then active and usable enough for the captcha cracking service... it would probably be more profitable just to monetise the porn.
    - jamessb 11y ago
      The closest thing to a documented case I've seen is a report of people gaming the Time Person of the Year poll so that the top person was moot, and the first letters of the candidates spelt out "Marblecake. Also the game.": By understanding how reCAPTCHA worked – the team was able to double their productivity (since they usually only had to enter one word instead of two). To further optimize their voting they created a poll front-end that allowed you to enter votes quickly while giving you an update of the poll status (and since it is a 4chan kind of crowd, they also provided the option to stream some porn just to keep you company while you are subverting one of the largest media companies in the world. https://musicmachinery.com/2009/04/27/moot-wins-time-inc-loses/ https://musicmachinery.com/2009/04/27/moot-wins-time-inc-los... However, this is slightly different as people were deliberately solving CAPTCHAs (and watching porn) rather than wanting to watch porn and also incidentally solving CAPTCHAs that they had no direct interest in.
- bpires 11y ago
  The author did compare their performance with captcha-solving services. His accuracy is comparable to the service with no extra cost to the attacker. From the paper: "We compare our performance to that of Decaptcher, the (self-reported) oldest captcha-solving service. We selected Decaptcher for two reasons. First, it supports the image reCaptcha, charging $2 per 1000 solved captchas. [...] Interestingly, some of our summitted challenges rejected due to the service being overloaded, and had to be resubmitted at a later time, and received a time-out error as the solvers did not provide an answer in the time window allocated by the service. 258 challenges (36.85%) were an exact match. When taking into account the flexibility, 321 (44.3%) of the captchas were solved. The average solving time for the challenges that received a solution was 22.5 seconds. While the accuracy may increase over time as the human solvers become more accustomed to the image reCaptcha, it is evident that our system is a cost-effective alternative. Nonetheless, our completely offline captcha-breaking system is comparable to a professional solving service in both accuracy and attack duration, with the added benefit of not incurring any cost on the attacker."
chinathrow 11y ago
I don't get why, when and how Google uses reCAPTCHA within their own tools. E.g. within the Webmaster Tools, I can submit up to 500 URLs for manual fetch/render and subsequent index submission. So the rate limit is already there and reasonable. However, after 4 submitted URLs, I get a reCAPTCHA. From then on for every URL, I have to complete it with additionaly visual quizzes.
- randunel 11y ago
  > I don't get why, when and how Google uses reCAPTCHA within their own tools. This may or may not help with your quest. Google triggers recaptcha when i use their search using one of my digitalocean servers as vpn and incognito mode, thus my IP address belongs to a datacentre, there isn't a cookie header and the user-agent is linux.
  - kuschku 11y ago
    I am on OVH, and never get a reCAPTCHA. (I used to use my OVH VPS for some time as VPN, so it has gained quite a reputation for a "normal" browsing history)
  - chinathrow 11y ago
    Thank you - I am using it absolutely genuine. The used account is in fact linked to an AdWords account which has spendings in the five digits...
- janesvilleseo 11y ago
  Another way they get triggered is when people use browser/desktop based rank checkers. There are also plugins some SEOs use to pull lots of requests. These tools are quite old now and not very useful, but people still use them.
  - chinathrow 11y ago
    Thanky you. I indeed han a chrome extension doing this. Removed and will check!
throwaway7767 11y ago
I have a bad feeling CloudFlare is going to break the internet for Tor users with impossible-to-solve CAPTCHAs again after this...
- Mahn 11y ago
  Not that it can become much worse than it already is, though. The current reCAPTCHAS are already "fuck this shit"-inducing on Tor.
  - throwaway7767 11y ago
    It very much can. Only a few months ago they were simply impossible. I tried to solve 30 of them while accessing a site and was still unable to. The current set are merely extremely annoying and time-consuming, but they can consistently be solved (at least by English speakers).
    - appenin 11y ago
      They can be consistently solved, the only problem is the endless repetition and "multiple answers needed" nonsense, which only seems to apply to Tor users.
JimmyM 11y ago
I may be being overly-cautious, but does anyone have a summary of this that isn't a PDF from blackhat.com? edit: Thanks for both responses!
- overlordalex 11y ago
  Here is the opening paragraph from the pdf: Since their inception, captchas have been widely used for preventing fraudsters from performing illicit actions. Nevertheless, economic incentives have resulted in an arms race, where fraudsters develop automated solvers and, in turn, captcha services tweak their design to break the solvers. Recent work, however, presented a generic attack that can be applied to any text-based captcha scheme. Fittingly, Google recently unveiled the latest version of reCaptcha. The goal of their new system is twofold; to minimize the effort for legitimate users, while requiring tasks that are more challenging to computers than text recognition. ReCaptcha is driven by an “advanced risk analysis system” that evaluates requests and selects the difficulty of the captcha that will be returned. Users may be required to click in a checkbox, or solve a challenge by identifying images with similar content. In this paper, we conduct a comprehensive study of reCaptcha, and explore how the risk analysis process is influenced by each aspect of the request. Through extensive experimentation, we identify flaws that allow adversaries to effortlessly influence the risk analysis, bypass restrictions, and deploy large-scale attacks. Subsequently, we design a novel low-cost attack that leverages deep learning technologies for the semantic annotation of images. Our system is extremely effective, automatically solving 70.78% of the image reCaptcha challenges, while requiring only 19 seconds per challenge. We also apply our attack to the Facebook image captcha and achieve an accuracy of 83.5%. Based on our experimental findings, we propose a series of safeguards and modifications for impacting the scalability and accuracy of our attacks. Overall, while our study focuses on reCaptcha, our findings have wide implications; as the semantic information conveyed via images is increasingly within the realm of automated reasoning, the future of captchas relies on the exploration of novel directions.
- liviu- 11y ago
  TL;DR from https://www.reddit.com/r/netsec/comments/4dvifg/im_not_a_human_breaking_the_google_recaptcha/d1uppxn https://www.reddit.com/r/netsec/comments/4dvifg/im_not_a_hum... (though you may be overly-cautious as blackhat.com seems to be the webpage of a computer security conference [1]): """ Live attack To obtain an exact measurement of our attack’s accuracy, we run our automated captcha-breaker against reCaptcha. We employ the Clarifai service as it shows the best result amount other services. Labelled dataset. We created a labelled dataset to exploit the image repetition. We manually labelled 3,000 images collected from challenges, and assigned each image a tag describing the content. We selected the appropriate tags from our hint list. We used pHash for the comparison, as it is very efficient, and allows our system to compare all the images from a challenge to our dataset in 3.3 seconds. We ran our captcha-breaking system against 2,235 captchas, and obtained a 70.78% accuracy. The higher accuracy compared to the simulated experiments is, at least partially, attributed to the image repetition; the history module located 1,515 sample images and 385 candidate images in our labelled dataset. Average run time. Our attack is very efficient, with an average duration of 19.2 seconds per challenge. The most time consuming phase is running GRIS, consuming phase, as it searches for all the images in Google and processes the results, including the extraction of links that point to higher resolution versions of the images. """ [1] https://en.wikipedia.org/wiki/Black_Hat_Briefings https://en.wikipedia.org/wiki/Black_Hat_Briefings
bluedino 11y ago
Using the Google's own reverse image search to break an image-based captcha. Simple, but brutal.
- neikos 11y ago
  Thought the same thing, that's ironic /and/ smart
  - proksoup 11y ago
    Perhaps in response google could identify their own image they just served from recaptcha being google searched and throw the google image search into a captcha jail? .... if they have a large enough pool of images they are using, to be able to make that correlation, and if google search and recaptcha are capable of sharing that level of intimate detail ... probably a lot of problems with that tho.
mc_hammer 11y ago
most annoying captcha ever tbh. im logged into my account and solve it 10x per day (slowly as fuck) and it cant tell im human yet? fucking fuckers.
bpires 11y ago
Quite interesting how the authors even mention that this strategy is very economically viable. From the paper: 'Assuming a selling price of $2 per 1,000 solved captchas, our token harvesting attack could accrue $104 - $110 daily, per host (i.e., IP address). By leveraging proxy services and running multiple attacks in parallel, this amount could be significantly higher for a single machine.'
- dc2 11y ago
  Makes me wonder if they got paid for reporting it to Google.
peternicky 11y ago
Anyone else annoyed with the grammar errors on the paper?
- unpixer 11y ago
  "We automately searches Google for certain terms, followes links from the results, watches video on Youtube, searches on Google Maps, visites popular websites that contains Google plus plugins and widgets." It's like reading a security paper authored by Gollum.
mirekrusin 11y ago
I guess we're all waiting for browser extension to fill in captcha for us, which is sometimes hard to get right, great usability improvement.
eveningcoffee 11y ago
I must admit that I have not been able to pass any of the text reCAPTCHA challenges lately when I have wanted to access the more sensitive content. Either I am getting them wrong or my submits get ignored.
chadscira 11y ago
I have used services like 2captcha.com, to get solving costs down to $0.5-$1 per 1000 solved captchas. Googles reCAPTCHA is hardly an effective solution... Also if google wanted to they could just automatically verify people without you clicking that checkbox. Because at the end of the day they already know if they are going to auto-verify you, or make you pass a test.
- byuu 11y ago
  Someone should really make a web browser plugin that automatically solves CloudFlare, Google and Facebook captchas for people using ::gasp:: VPNs. I would happily pay $1 for every 1000 captchas served at me to be solved for me, even if it took the page a bit longer to load for me still. As long as the latency wasn't too much higher than it'd take me to solve it myself. Just like with DRM, captchas only seem to punish legitimate users and perhaps very small-time bad actors.
tyingq 11y ago
"We ran our captcha-breaking system against 2,235 captchas, and obtained a 70.78% accuracy" That's more impressive than it sounds. I'm pretty sure 70.78% is more accurate than I am with reCAPTCHA manually. A lot of the captcha's presented are very fuzzy, or have ambiguous questions, etc.
- gboudrias 11y ago
  Indeed. It's good that these guys are white-hats because they could have made a killing selling to spammers (for as long as they could go undetected, which could've been a while).
  - tyingq 11y ago
    "This work was supported by the NSF under grant CNS-13-18415" I think that means you might be able to get source code via FOIA or similar :)
  - etrain 11y ago
    Going rate for humans breaking captchas is like $1/1000 captchas solved. A fully automated service could make some money, sure, but not exactly a killing.
    - seanp2k2 11y ago
      Yeah; that's the problem...you can make, with tons of effort, a fairly decent system to tell robots and humans apart, but it's much much more difficult to tell humans trying to do the thing directly from those solving the challenge remotely. It's an arms race of economics; the challenge has to be difficult enough that it slows down humans in sweatshops to the point where it makes the whole enterprise not worthwhile for the abusers while not pissing off your actual users. It also has to resist automated malicious use. Quite a tall order. The best I've seen are the "which of these photos show mountains"-type challenges. I'd imagine that solving 5 rounds of those would take too long to make it worthwhile for spammers, but I'd also imagine lots of legitimate users getting irked at going through that to fill out a form.
    - 11y ago
kauegimenes 11y ago
I am the only one who thinks google reCAPTCHA is just a tool that Google uses to train Machine Learning Algorithms? First it was used to help Google learn how to Read, now its learning to detect object, landscapes, ...
- sp332 11y ago
  The little captcha box does some processing before deciding what to show you. If you look suspicious, it can show you a more complex challenge. If you look like a normal browser, it might show you a house number to read (to improve its Maps product maybe). If you already have a cookie set because you already proved you're human, maybe it's just that check-box that says "I'm a human".
  - nxzero 11y ago
    Unless you're able to explicitly state how this is done and/or how to trick it in think you're "high risk" - then seems like speculation; yes, I'm aware Google's said this, but never seen an proof of it. I've found bug in the past in the system that were easy to fix, told Google, but the bugs never were fixed.
    - yaur 11y ago
      Try doing a Google search from tor. The catches that tor users get are borderline impossible because of the suspicious ip and/or browser.
      - SCHiM 11y ago
        Not impossible, very often I get the "Body of water" one, but I do seem to get a challenge every 10 minutes or so, in each new tab.
    - ruraljuror 11y ago
      It's not speculation. It's section 2 of the paper, titled "Analyzing Risk Analysis System."
kajecounterhack 11y ago
http://arxiv.org/abs/1602.02697 http://arxiv.org/abs/1602.02697 I don't work on reCAPTCHA but I imagine they could easily + significantly beef up image captcha by adding adversarial image examples that trip up would-be automators. Note that adversarial examples generalize across models. Meaning a good adversarial example will work against SVMs, convnets, etc just the same. If you're interested in the basics of how it works, Julia Evans has a great post: jvns.ca/blog/2015/12/24/how-to-trick-a-neural-network-into-thinking-a-panda-is-a-vulture The key is that deep neural nets are actually very (piecewise) linear and that makes them susceptible to adversarial training.
- olalonde 11y ago
  Or use those images: http://imgur.com/a/K4RWn http://imgur.com/a/K4RWn :)
mpeg 11y ago
I worked on a little piece on recaptcha a while ago[0]. I'm glad to see research around how this captcha method is actually as breakable as any, but the real problem continues to be that there is no separation between the data Google collects for advertising, and the data Google collects from the captcha service. Their privacy policy says they can link the captcha to your other online identity and use it to target you. It's especially cringeworthy to see lots of sites of dubious legality implement reCAPTCHA (like thepiratebay). [0]: http://www.businessinsider.com/google-no-captcha-adtruth-privacy-research-2015-2 http://www.businessinsider.com/google-no-captcha-adtruth-pri...?
Matt3o12_ 11y ago
> Over the period of the following 6 months, text captchas appeared to be gradually “phased out”, with the image captcha now being the default type returned, as these captchas are harder for humans to solve despite being solvable by bots [3, 4]. This is so true. When I first go an image captcha, it took me 3 minutes to learn how to solve it. I had JavaScript disabled so I did not realize I had to do 3 pages to complete the challenge (after two, I reloaded and got a new route thanks to tor the page since I though i message up). Also I'm not sure what to click when there is a partial match, is that still a match? And don't even get me started with solving signs (in my first challenge I had to tell apart different kind of signs that were in the image). Is a no trespassing sign still a traffic sign? What about if it is a sign but I don't know which kind of sign (due to domain knowledge – especially when they're foreign signs). Another problem is that they require you to understand the language the challenge is in. You can still solve a text captcha if you don't speak any English. I wish there was a way to force text captchas
dylanpyle 11y ago
One of the more interesting references linked here was https://github.com/neuroradiology/InsideReCaptcha https://github.com/neuroradiology/InsideReCaptcha — apparently the reCAPTCHA JavaScript snippet uses an encrypted bytecode format running on a custom-built VM, which one intrepid person has decompiled.

166 points by louis-paul 11y ago

You could also just pay a service that uses human workers in third world counties. It's a little over a tenth of a cent per captcha.

davedx 11y ago
Not so economical if you want to brute force a login page.
amelius 11y ago
Or you could set up a pr0n site that shows the material only after the user has completed the captcha. This trick has been done before.
- dspillett 11y ago
  I've never seen a documented case of such tricks actually being used, and I've seen calculations that suggest the cost/benefit outcome is no better than just paying the poor to do the menial work. The last such analysis I paid attention to was some years ago so the situation may have changed, but I suspect the hassles of running a porn site and CAPCHA proxy still aren't worth it: * obtaining content sufficient to attract interest * paying for bandwidth & other resources) * writing the authentication system * then maintaining it (every time the CAPCHA service(s) change their process you potentially need to make and test changes to your code) * and you need to work around rate limits (depending on the CAPCH design it may not be possible to make the relevant requests client-side so if the services has rate limits you'll have to route through something that sufficiently randomises your source address). * providing support * dealing with bad press
  - ErrantX 11y ago
    And also, if you got to the point where that porn site was then active and usable enough for the captcha cracking service... it would probably be more profitable just to monetise the porn.
  - jamessb 11y ago
    The closest thing to a documented case I've seen is a report of people gaming the Time Person of the Year poll so that the top person was moot, and the first letters of the candidates spelt out "Marblecake. Also the game.": By understanding how reCAPTCHA worked – the team was able to double their productivity (since they usually only had to enter one word instead of two). To further optimize their voting they created a poll front-end that allowed you to enter votes quickly while giving you an update of the poll status (and since it is a 4chan kind of crowd, they also provided the option to stream some porn just to keep you company while you are subverting one of the largest media companies in the world. https://musicmachinery.com/2009/04/27/moot-wins-time-inc-loses/ https://musicmachinery.com/2009/04/27/moot-wins-time-inc-los... However, this is slightly different as people were deliberately solving CAPTCHAs (and watching porn) rather than wanting to watch porn and also incidentally solving CAPTCHAs that they had no direct interest in.
bpires 11y ago
The author did compare their performance with captcha-solving services. His accuracy is comparable to the service with no extra cost to the attacker. From the paper: "We compare our performance to that of Decaptcher, the (self-reported) oldest captcha-solving service. We selected Decaptcher for two reasons. First, it supports the image reCaptcha, charging $2 per 1000 solved captchas. [...] Interestingly, some of our summitted challenges rejected due to the service being overloaded, and had to be resubmitted at a later time, and received a time-out error as the solvers did not provide an answer in the time window allocated by the service. 258 challenges (36.85%) were an exact match. When taking into account the flexibility, 321 (44.3%) of the captchas were solved. The average solving time for the challenges that received a solution was 22.5 seconds. While the accuracy may increase over time as the human solvers become more accustomed to the image reCaptcha, it is evident that our system is a cost-effective alternative. Nonetheless, our completely offline captcha-breaking system is comparable to a professional solving service in both accuracy and attack duration, with the added benefit of not incurring any cost on the attacker."

chinathrow 11y ago

I don't get why, when and how Google uses reCAPTCHA within their own tools. E.g. within the Webmaster Tools, I can submit up to 500 URLs for manual fetch/render and subsequent index submission. So the rate limit is already there and reasonable. However, after 4 submitted URLs, I get a reCAPTCHA. From then on for every URL, I have to complete it with additionaly visual quizzes.

randunel 11y ago
> I don't get why, when and how Google uses reCAPTCHA within their own tools. This may or may not help with your quest. Google triggers recaptcha when i use their search using one of my digitalocean servers as vpn and incognito mode, thus my IP address belongs to a datacentre, there isn't a cookie header and the user-agent is linux.
- kuschku 11y ago
  I am on OVH, and never get a reCAPTCHA. (I used to use my OVH VPS for some time as VPN, so it has gained quite a reputation for a "normal" browsing history)
- chinathrow 11y ago
  Thank you - I am using it absolutely genuine. The used account is in fact linked to an AdWords account which has spendings in the five digits...
janesvilleseo 11y ago
Another way they get triggered is when people use browser/desktop based rank checkers. There are also plugins some SEOs use to pull lots of requests. These tools are quite old now and not very useful, but people still use them.
- chinathrow 11y ago
  Thanky you. I indeed han a chrome extension doing this. Removed and will check!

throwaway7767 11y ago

I have a bad feeling CloudFlare is going to break the internet for Tor users with impossible-to-solve CAPTCHAs again after this...

Mahn 11y ago
Not that it can become much worse than it already is, though. The current reCAPTCHAS are already "fuck this shit"-inducing on Tor.
- throwaway7767 11y ago
  It very much can. Only a few months ago they were simply impossible. I tried to solve 30 of them while accessing a site and was still unable to. The current set are merely extremely annoying and time-consuming, but they can consistently be solved (at least by English speakers).
  - appenin 11y ago
    They can be consistently solved, the only problem is the endless repetition and "multiple answers needed" nonsense, which only seems to apply to Tor users.

JimmyM 11y ago

I may be being overly-cautious, but does anyone have a summary of this that isn't a PDF from blackhat.com? edit: Thanks for both responses!

overlordalex 11y ago
Here is the opening paragraph from the pdf: Since their inception, captchas have been widely used for preventing fraudsters from performing illicit actions. Nevertheless, economic incentives have resulted in an arms race, where fraudsters develop automated solvers and, in turn, captcha services tweak their design to break the solvers. Recent work, however, presented a generic attack that can be applied to any text-based captcha scheme. Fittingly, Google recently unveiled the latest version of reCaptcha. The goal of their new system is twofold; to minimize the effort for legitimate users, while requiring tasks that are more challenging to computers than text recognition. ReCaptcha is driven by an “advanced risk analysis system” that evaluates requests and selects the difficulty of the captcha that will be returned. Users may be required to click in a checkbox, or solve a challenge by identifying images with similar content. In this paper, we conduct a comprehensive study of reCaptcha, and explore how the risk analysis process is influenced by each aspect of the request. Through extensive experimentation, we identify flaws that allow adversaries to effortlessly influence the risk analysis, bypass restrictions, and deploy large-scale attacks. Subsequently, we design a novel low-cost attack that leverages deep learning technologies for the semantic annotation of images. Our system is extremely effective, automatically solving 70.78% of the image reCaptcha challenges, while requiring only 19 seconds per challenge. We also apply our attack to the Facebook image captcha and achieve an accuracy of 83.5%. Based on our experimental findings, we propose a series of safeguards and modifications for impacting the scalability and accuracy of our attacks. Overall, while our study focuses on reCaptcha, our findings have wide implications; as the semantic information conveyed via images is increasingly within the realm of automated reasoning, the future of captchas relies on the exploration of novel directions.
liviu- 11y ago
TL;DR from https://www.reddit.com/r/netsec/comments/4dvifg/im_not_a_human_breaking_the_google_recaptcha/d1uppxn https://www.reddit.com/r/netsec/comments/4dvifg/im_not_a_hum... (though you may be overly-cautious as blackhat.com seems to be the webpage of a computer security conference [1]): """ Live attack To obtain an exact measurement of our attack’s accuracy, we run our automated captcha-breaker against reCaptcha. We employ the Clarifai service as it shows the best result amount other services. Labelled dataset. We created a labelled dataset to exploit the image repetition. We manually labelled 3,000 images collected from challenges, and assigned each image a tag describing the content. We selected the appropriate tags from our hint list. We used pHash for the comparison, as it is very efficient, and allows our system to compare all the images from a challenge to our dataset in 3.3 seconds. We ran our captcha-breaking system against 2,235 captchas, and obtained a 70.78% accuracy. The higher accuracy compared to the simulated experiments is, at least partially, attributed to the image repetition; the history module located 1,515 sample images and 385 candidate images in our labelled dataset. Average run time. Our attack is very efficient, with an average duration of 19.2 seconds per challenge. The most time consuming phase is running GRIS, consuming phase, as it searches for all the images in Google and processes the results, including the extraction of links that point to higher resolution versions of the images. """ [1] https://en.wikipedia.org/wiki/Black_Hat_Briefings https://en.wikipedia.org/wiki/Black_Hat_Briefings

bluedino 11y ago

Using the Google's own reverse image search to break an image-based captcha. Simple, but brutal.

neikos 11y ago
Thought the same thing, that's ironic /and/ smart
- proksoup 11y ago
  Perhaps in response google could identify their own image they just served from recaptcha being google searched and throw the google image search into a captcha jail? .... if they have a large enough pool of images they are using, to be able to make that correlation, and if google search and recaptcha are capable of sharing that level of intimate detail ... probably a lot of problems with that tho.

mc_hammer 11y ago

most annoying captcha ever tbh. im logged into my account and solve it 10x per day (slowly as fuck) and it cant tell im human yet? fucking fuckers.

bpires 11y ago

Quite interesting how the authors even mention that this strategy is very economically viable. From the paper: 'Assuming a selling price of $2 per 1,000 solved captchas, our token harvesting attack could accrue $104 - $110 daily, per host (i.e., IP address). By leveraging proxy services and running multiple attacks in parallel, this amount could be significantly higher for a single machine.'

dc2 11y ago
Makes me wonder if they got paid for reporting it to Google.

peternicky 11y ago

Anyone else annoyed with the grammar errors on the paper?

unpixer 11y ago
"We automately searches Google for certain terms, followes links from the results, watches video on Youtube, searches on Google Maps, visites popular websites that contains Google plus plugins and widgets." It's like reading a security paper authored by Gollum.

mirekrusin 11y ago

I guess we're all waiting for browser extension to fill in captcha for us, which is sometimes hard to get right, great usability improvement.

eveningcoffee 11y ago

I must admit that I have not been able to pass any of the text reCAPTCHA challenges lately when I have wanted to access the more sensitive content. Either I am getting them wrong or my submits get ignored.

chadscira 11y ago

I have used services like 2captcha.com, to get solving costs down to $0.5-$1 per 1000 solved captchas. Googles reCAPTCHA is hardly an effective solution... Also if google wanted to they could just automatically verify people without you clicking that checkbox. Because at the end of the day they already know if they are going to auto-verify you, or make you pass a test.

byuu 11y ago
Someone should really make a web browser plugin that automatically solves CloudFlare, Google and Facebook captchas for people using ::gasp:: VPNs. I would happily pay $1 for every 1000 captchas served at me to be solved for me, even if it took the page a bit longer to load for me still. As long as the latency wasn't too much higher than it'd take me to solve it myself. Just like with DRM, captchas only seem to punish legitimate users and perhaps very small-time bad actors.

tyingq 11y ago

"We ran our captcha-breaking system against 2,235 captchas, and obtained a 70.78% accuracy" That's more impressive than it sounds. I'm pretty sure 70.78% is more accurate than I am with reCAPTCHA manually. A lot of the captcha's presented are very fuzzy, or have ambiguous questions, etc.

gboudrias 11y ago
Indeed. It's good that these guys are white-hats because they could have made a killing selling to spammers (for as long as they could go undetected, which could've been a while).
- tyingq 11y ago
  "This work was supported by the NSF under grant CNS-13-18415" I think that means you might be able to get source code via FOIA or similar :)
- etrain 11y ago
  Going rate for humans breaking captchas is like $1/1000 captchas solved. A fully automated service could make some money, sure, but not exactly a killing.
  - seanp2k2 11y ago
    Yeah; that's the problem...you can make, with tons of effort, a fairly decent system to tell robots and humans apart, but it's much much more difficult to tell humans trying to do the thing directly from those solving the challenge remotely. It's an arms race of economics; the challenge has to be difficult enough that it slows down humans in sweatshops to the point where it makes the whole enterprise not worthwhile for the abusers while not pissing off your actual users. It also has to resist automated malicious use. Quite a tall order. The best I've seen are the "which of these photos show mountains"-type challenges. I'd imagine that solving 5 rounds of those would take too long to make it worthwhile for spammers, but I'd also imagine lots of legitimate users getting irked at going through that to fill out a form.
  - 11y ago

kauegimenes 11y ago

I am the only one who thinks google reCAPTCHA is just a tool that Google uses to train Machine Learning Algorithms? First it was used to help Google learn how to Read, now its learning to detect object, landscapes, ...

sp332 11y ago
The little captcha box does some processing before deciding what to show you. If you look suspicious, it can show you a more complex challenge. If you look like a normal browser, it might show you a house number to read (to improve its Maps product maybe). If you already have a cookie set because you already proved you're human, maybe it's just that check-box that says "I'm a human".
- nxzero 11y ago
  Unless you're able to explicitly state how this is done and/or how to trick it in think you're "high risk" - then seems like speculation; yes, I'm aware Google's said this, but never seen an proof of it. I've found bug in the past in the system that were easy to fix, told Google, but the bugs never were fixed.
  - yaur 11y ago
    Try doing a Google search from tor. The catches that tor users get are borderline impossible because of the suspicious ip and/or browser.
    - SCHiM 11y ago
      Not impossible, very often I get the "Body of water" one, but I do seem to get a challenge every 10 minutes or so, in each new tab.
  - ruraljuror 11y ago
    It's not speculation. It's section 2 of the paper, titled "Analyzing Risk Analysis System."

kajecounterhack 11y ago

http://arxiv.org/abs/1602.02697 http://arxiv.org/abs/1602.02697 I don't work on reCAPTCHA but I imagine they could easily + significantly beef up image captcha by adding adversarial image examples that trip up would-be automators. Note that adversarial examples generalize across models. Meaning a good adversarial example will work against SVMs, convnets, etc just the same. If you're interested in the basics of how it works, Julia Evans has a great post: jvns.ca/blog/2015/12/24/how-to-trick-a-neural-network-into-thinking-a-panda-is-a-vulture The key is that deep neural nets are actually very (piecewise) linear and that makes them susceptible to adversarial training.

olalonde 11y ago
Or use those images: http://imgur.com/a/K4RWn http://imgur.com/a/K4RWn :)

mpeg 11y ago

I worked on a little piece on recaptcha a while ago[0]. I'm glad to see research around how this captcha method is actually as breakable as any, but the real problem continues to be that there is no separation between the data Google collects for advertising, and the data Google collects from the captcha service. Their privacy policy says they can link the captcha to your other online identity and use it to target you. It's especially cringeworthy to see lots of sites of dubious legality implement reCAPTCHA (like thepiratebay). [0]: http://www.businessinsider.com/google-no-captcha-adtruth-privacy-research-2015-2 http://www.businessinsider.com/google-no-captcha-adtruth-pri...?

Matt3o12_ 11y ago

> Over the period of the following 6 months, text captchas appeared to be gradually “phased out”, with the image captcha now being the default type returned, as these captchas are harder for humans to solve despite being solvable by bots [3, 4]. This is so true. When I first go an image captcha, it took me 3 minutes to learn how to solve it. I had JavaScript disabled so I did not realize I had to do 3 pages to complete the challenge (after two, I reloaded and got a new route thanks to tor the page since I though i message up). Also I'm not sure what to click when there is a partial match, is that still a match? And don't even get me started with solving signs (in my first challenge I had to tell apart different kind of signs that were in the image). Is a no trespassing sign still a traffic sign? What about if it is a sign but I don't know which kind of sign (due to domain knowledge – especially when they're foreign signs). Another problem is that they require you to understand the language the challenge is in. You can still solve a text captcha if you don't speak any English. I wish there was a way to force text captchas

dylanpyle 11y ago

One of the more interesting references linked here was https://github.com/neuroradiology/InsideReCaptcha https://github.com/neuroradiology/InsideReCaptcha — apparently the reCAPTCHA JavaScript snippet uses an encrypted bytecode format running on a custom-built VM, which one intrepid person has decompiled.