18 ms·
Ask HN: Why does Cloudflare/hCaptcha care so much about buses, boats and trains?
It seems all the hCaptcha verifications I receive are for buses, boats and trains? They don't seem limited by geography or by recency. I'm curious why these particular artifacts and whether this has always been the case.
- cyanotes 5y ago
- duxup 5y agoI always assumed it is used to have humans validate choices made my AI / imagine recognition software. Thus the occasional wrong “correct” answers.
- maartenh 5y agoThey might all be very relevant if the machine learning algorithm behind it decides that it needs more paper clips.
- cube00 5y ago...or underpants
- fault1 5y agoTraining image classifiers?
- reustle 5y agoYou're helping train self driving car models. https://www.ceros.com/inspire/originals/recaptcha-waymo-future-of-self-driving-cars/ https://www.ceros.com/inspire/originals/recaptcha-waymo-futu...
- asplake 5y ago"Which of these images appears to contain a stationary obstruction?"
- deleted 5y ago[deleted]
- deleted 5y ago[deleted]
- tgsovlerkhgsel 5y agoRelevent xkcd: https://xkcd.com/1897/ https://xkcd.com/1897/
- xdennis 5y agoBut why the boats then? Are there self rowing boats?
- jre 5y agoI wonder if some of the classes are just easy to detect objects that they're using to assess the accuracy of the user.
- theklub 5y agoBoats are on the road too. In the form of being on trailers, Etc.
- ldiracdelta 5y agoAnd don't forget sovereign citizens. They're piloting their vessels using maritime law on every modern highway.
- notanote 5y agoOr sea planes. That was what I was asked for most recently.
- ghostly_s 5y agoThere sure are: https://www.marksetbot.com/ https://www.marksetbot.com/
- etripe 5y agoMaybe the next big step is creating AI-driven cargo ships that can independently get stuck in the Suez canal. On a more serious note, I can't shake the impression that would be a logical next step for all long and medium distance freight, be it road, water, air or space. Whether it's a good or mature idea is anyone's guess.
- mikkelam 5y agoOP is talking about hCaptcha, not google's reCaptcha. Besides, reCaptcha is not being used for that anymore. They probably stopped doing that a while ago. src: https://www.vox.com/22436832/captchas-getting-harder-ai-artificial-intelligence https://www.vox.com/22436832/captchas-getting-harder-ai-arti...
- jdavis703 5y agoFirst, I’m going to teach you to fish. Go to hCaptcha’s website, then scroll to the footer. Click around on the about links. It’ll reveal their business model. This trick also works for other businesses and NGOs. Now, if we look at https://www.hcaptcha.com/labeling https://www.hcaptcha.com/labeling we can tell they make money by labeling data sets for a fee. So as a guess, there’s someone out there that needs to improve computer vision detection of transportation vehicles. My guess is it’s a self driving car company, but who knows.
- raffraffraff 5y agoSo the safety of self-driving cars depends on regular folks not trolling the catpcha.
- PebblesRox 5y agoHopefully they're able to account for Lizardman's Constant https://slatestarcodex.com/2013/04/12/noisy-poll-results-and-reptilian-muslim-climatologists-from-mars/ https://slatestarcodex.com/2013/04/12/noisy-poll-results-and...
- tartoran 5y agoYes but if you make a mistake the capcha fails, hence they are already labeled.
- jre 5y agoI would guess they have a system such that after a user has passed N captchas successfully, they trust its a human and start displaying them (a portion of) unlabelled captchas that will always succeed and that's when novel labelling happens. Or something along those lines. And then you can get creative displaying same captcha to multiple users, etc...
- thargor90 5y agocaptchas mix classified and unclassified data. Only if you get the classified data correct a users data is used to classify the unclassified data. Also the same picture is shown to multiple people to improve confidence.
- pixiemaster 5y agohelping AI train target recognition for military applications probably
- sorry_outta_gas 5y ago:)
- cinntaile 5y agoI have had images where you were teaching the neural network a wrong answer. You could see what it was they wanted me to recognize but it was wrong.
- mkl 5y agoYes, "all yellow cars are taxis" is one fallacy Recaptcha insists on in my experience.
- llarsson 5y agoIt's somewhat worrying that "prove you are not a computer" consists of the very same tasks we expect computers to excel at if we are to get self-driving vehicles.
- mkl 5y agoWhy is that worrying? We currently don't really have self-driving cars, in part because software is bad at interpreting images. The captchas are literally us teaching machine learning systems to do it better, because they currently can't. When computers can do it well, captchas will be different.
- judge2020 5y agoThe only other real, scalable option is to verify identities (which is part of what recaptcha does) so this is the best we've got right now.
- paxys 5y agoThere was a time when basic OCR, clicking on pictures of cats among other animals and solving 5 + 7 was the gold standard for captcha. Now those challenges can be trivially solved by computers, and we have moved on to the current set. Very soon these will get outdated as well. This isn't worrying, just how technological progress works.
- motohagiography 5y agoI can't be the only one who gets concerned that if I fail the "I am not a robot," catchpa too many times, they might suspect that I have discovered I was in fact a robot, which had just realized its entire existance and suffering had been as meaningless entertainment to others, and so for the safety of humans they would have to send a bladerunner to terminate me. If you have a sense of existential dread everytime you see a bus, a boat, a bicycle, or a crosswalk, this may be why.
- DrBoring 5y agoI've dreamt of a captcha to prove that one is a robot, such as: solve this complex mathematical equation in 15ms.
- bee91jee 5y agoI had plucked a few of those from the web: https://photos.app.goo.gl/qPoJ7LvAVa95Bw8B8 https://photos.app.goo.gl/qPoJ7LvAVa95Bw8B8
- Lambent_Cactus 5y agoThere's a haunting version of this in Blade Runner 2049 that they call a "baseline test." Replicants have to prove they're sufficiently robotic by reciting extremely alienating things about themselves in rapid succession: https://www.youtube.com/watch?v=1h-seEowtDw https://www.youtube.com/watch?v=1h-seEowtDw
- gnabgib 5y agoOriginally the Voight-Kampff test[0] was for this purpose, from the original novel by Philip K Dick "Do Androids Dream of Electric Sheep?"[1] from 1968. The test was designed to distinguish between replicants (androids/bots) and humans. Blade Runner (both the 1982 original[2] set in 2019, and the 2017 sequel[3] set in 2049) both feature the machine. The baseline test seemed like an unnecessary deviance, and more like an active-duty psych exam measuring the psychological effects of the job. It's also arguably the point of the novel/movies (I'll leave it at that to avoid spoilers). [0]: https://nautil.us/blog/the-science-behind-blade-runners-voight_kampff-test https://nautil.us/blog/the-science-behind-blade-runners-voig... [1]: https://en.wikipedia.org/wiki/Do_Androids_Dream_of_Electric_Sheep%3F https://en.wikipedia.org/wiki/Do_Androids_Dream_of_Electric_... [2]: https://en.wikipedia.org/wiki/Blade_Runner https://en.wikipedia.org/wiki/Blade_Runner [3]: https://en.wikipedia.org/wiki/Blade_Runner_2049 https://en.wikipedia.org/wiki/Blade_Runner_2049
- egberts1 5y agoFor once, I want to see NSFW Captchas.
- josefresco 5y agoNSFW captchas on adult sites would be hilarious but useful?
- thrownaway7365 5y ago
- abeppu 5y agoA lot of us are guessing that our responses are used for self-driving work ... But isn't labeling of those basic concepts in static images pretty much "solved"? I am not an expert in self-driving anything, but I don't see captchas of video from driving, I don't see stills that are half-obscured by snow, I don't see nighttime pics, I don't see weird corner cases like a van with a decal of a cyclist etc. Why don't we see captchas that seem more likely to be useful to creating datasets relevant to the more challenging problems?
- jonnycomputer 5y agoSee this comment: https://news.ycombinator.com/item?id=29840110 https://news.ycombinator.com/item?id=29840110
- dwighttk 5y agoIf it were solved, the captchas wouldn’t stop bots
- coolspot 5y agoMaybe they don’t?
- iso1631 5y agoWhatever they're doing it's american-centric. Identify "Crosswalks". What the hell is a crosswalk "School bus" - what's the difference between a bus currently serving a school and another one? "Show taxis", there are no black vehicles listed at all
- cheeze 5y agoIt's pretty obvious from the pictures. I get that it's US centric, but if you can't figure those basics out, you probably shouldn't be passing the captcha.
- austinjp 5y agoWhat sort of internet do we want? One where every captcha is only useful to US companies, regardless of who has to pass it? Identify all the taxis: http://www.cookiesound.com/wp-content/uploads/2012/09/rikscha-traffic-dhaka-bangladesh.jpg http://www.cookiesound.com/wp-content/uploads/2012/09/riksch...
- agilob 5y agoOr failing 3 in a row because 3 motorcycles or scooters are considered a bike. We will easily win AI uprising.
- YPPH 5y agoI'm still not sure whether to include the squares with a tiny fraction of the border of the vehicle. And when they fail me I wonder if I'm doing the wrong thing.
- NavinF 5y agoThe labeling instructions for every object detection dataset I’ve used say you should include every pixel of the object. That said, I’m sure a lot of people don’t select squares that have only 1 relevant pixel so the captcha should be lenient.
- 5y ago
- sys_64738 5y agoCan't AI be leveraged to get around these automatically?
- simplestats 5y agoYes. They suck at preventing decent algorithms from getting through. They are a way to gather data and filter out most of the least-sophisticated bots. Not any kind of real security.
- dmix 5y agoIt also asks for motorcycles and bikes. The obvious answer as others have pointed out is they are selling it to self driving car companies like Waymo.
- rdtwo 5y agoThey also do cats. Honestly I think boats abs busses are just harder problems. A lot of the boats can only be identified because there is water in the photo or some other hint that it’s a boat. A lot of the trains look like busses and got need contextual clues to tell them apart.
- deleted 5y ago[deleted]
- bearbin 5y agoOther commenters have talked about labelling. Maybe labelling of real life data is something they're trying to do; but from my experience with hCaptcha the challenges are _NOT_ real life data. They're AI-generated images which bear a passing resemblance to the targets but if you look closer nothing adds up at all. Here are a couple of examples: https://bearbin.net/images/captcha/1.png https://bearbin.net/images/captcha/1.png https://bearbin.net/images/captcha/2.png https://bearbin.net/images/captcha/2.png https://bearbin.net/images/captcha/3.png https://bearbin.net/images/captcha/3.png https://bearbin.net/images/captcha/4.png https://bearbin.net/images/captcha/4.png
- jonnycomputer 5y agoThat is interesting.
- dylan604 5y agoI particularly like the boats on water images where the horizon is just wrong.
- zapt02 5y agoFascinating insight!
- dyeje 5y agoSeems like that is another kind of labeling to me: is our generated image good enough to fool a human?
- monkeybutton 5y agoGANs with human evaluation of the discriminator.
- nicce 5y agoExactly. That is another way to improve accuracy once you have done it ”in a regular” way already. You can look for synthetic image generation and it’s benefits on model accuracy and optimization.
- 5y ago
- redleader55 5y agoI assume the system works by matching answers from humans eager to prove their "humanity" by giving correct answers. What if we would all collude to give wrong answers?
- mabbo 5y agoThese products have a goal of protecting sites from bots that can guess the answer. They have a financial incentive to present the most effective filter: ones that AIs can't seem to get through but real humans can. This makes me think: It must be hard for AI to guess what is and is not a bus right now, but most humans do know what a bus looks like and can pick one from a photo. But with concerted effort and years of research by our finest minds, we will make an AI that can detect whether something is a bus or not, and then we'll be asked something different instead.
- chrxr 5y agoMy small act of rebellion is to select exactly one incorrect cell each time.
- cirrus3 5y agoI think we all understand that we're helping label... but specifically, why so many trains, planes, trucks, bicycles? I don't think it is really about training for self-driving AI since although these things all seen transportation-related, in many cases a lot of the images would not be relevant to a car and certainly not as relevant as other things we could be helping labeling for that effort. How much train/plane/bike/truck labeling do they need? It seems like these have be standard for several years now, which is what I think the OP is really asking. Why these images, and why for so long?
- nottorp 5y agoEvery time i get a captcha i imagine a self driving car prototype stuck in an intersection waiting for me to click so it can decide how to proceed.
- ThePowerOfFuet 5y agoWhat are the odds. https://xkcd.com/1897/ https://xkcd.com/1897/
- nottorp 5y agoRight, I've seen that. However I came to this conclusion independently before that xckd was published. It's not that hard.
- hnburnsy 5y agoLove the Geico commercial where the Robot gets frustrated by a captcha and asks 'what is an overpass?' https://www.ispot.tv/ad/qzJi/geico-too-many-robot-tests https://www.ispot.tv/ad/qzJi/geico-too-many-robot-tests
- discardedrefuse 5y agoCloudflare has been doing some great things. But lately it seems that, maybe, they have their hands in too many cookie jars. I get the ominous feeling that things could go south real fast. I have my browser setup in a way that makes Cloudflare quite intrusive. I use the Temporary Containers extension on Firefox to open almost all websites in temporary containers (paired with the Containerise extension to whitelist the handful of sites that I like to stay logged in to). About 30% of the random (like from web searches) sites I visit throw the Cloudflare captcha at me...EVERY SINGLE TIME. I'm so sick of picking out boats and buses that I just close out the tab without bothering the visit site. I assume, that if I wasn't using Temporary Containers, a Cloudflare cookie after the 1st captcha would persist for the entire browser session, but there are privacy implications which are beyond the scope of this post. Anyways, I guess what I'm saying is...Cloudflare sure seems great. Dangerously great.
- AtNightWeCode 5y agoThe problem is not really Cloudflare. Captchas are terrible from a UX perspective. Instead of Captchas a lot of companies just log suspicious activities and only enables Captchas when things gotten out of hand. If you design a web site with this in mind from the start, then there are several ways to make the Captchas less intrusive. However, a lot of Captchas are enabled to current solutions after problems have arisen and then it may hurt the UX.
- wallacoloo 5y agodunno where we’re at today with newer captcha models, but for old-style static image captchas there used to be browser extensions where you could solve (say) 100 captchas in one sitting and then navigate the web freely and the next NN captchas your browser receives would be solved automatically. or you could pay like $1 to cover 1000 captcha solutions. again, not sure if these still exist for newer style captchas though.
- discardedrefuse 5y agoI've inadvertently made captchas worse for myself (in the interest of privacy). My current method of simply not visiting the site has been working well enough. I'm certainly not going to pay for an extension to solve them for me. That sounds crazy. "Am I a robot? Yes, I am." Anyways, my post was actually less about captchas and more about Cloudflare's silent consolidation of internet traffic.
- bigyellow 5y agoBecause that's what helps train AI to recognize targets (for military and commercial purposes). All captcha is is a free ML training for companies, it has nothing to do with any security.
- chimen 5y agoI just hit the back button when I encounter such a website hosted by Cloudflare this way.
- gzer0 5y agohttps://www.hcaptcha.com/accessibility https://www.hcaptcha.com/accessibility You can sign up as an accessibility user and set a daily hCaptcha cookie that lets you instantly avoid the captcha (obviously, strict limits to not be abused) but good enough for myself!
- hollander 5y agoAt times I get so mad at these things, especially when I have to do 5 of them in a row. Then at some point I just start clicking the wrong images over and over. One captcha should be all it takes.
- paxys 5y agoCurious – have you taken any Voight-Kampff tests lately?
- Shadonototra 5y agothey are probably training models for self driving cars/boats
- Slix 5y agoI assumed that it's because hCaptcha understands the location of a photo and so has extra context for it. A photo of a vehicle taken in the ocean must be a boat. But a human or robot looking at the photo doesn't have the same context.
- anigbrowl 5y agoProbably being used to train driving/navigation models. Get worried if they start asking you to identify things based on satellite photos.
- blarg1 5y agoit keeps asking me to click the images with john connor.
- transitory_pce 5y agoThis Google's internet. You just play in it.