5 ms·
If I look into my mirrors to make sure I am safe to change lanes, it dings me for distraction because my face is turned to look into my mirror. WTF. This seem
by userbinator 5y ago
If I look into my mirrors to make sure I am safe to change lanes, it dings me for distraction because my face is turned to look into my mirror.
WTF.
This seems like the real-world analogy of a similar trend I've noticed in software development where, to "improve code quality", humans are replaced with stupid tools that give false positives all the time, and to placate their warnings and satisfy the metrics of the management imposing them, writing code becomes perverted into trying to figure out how to stop the tool from complaining instead of focusing on the actual problem being solved.
- trhway 5y agocan the driver just put a photo of himself in front of the camera and score total bonus for being always on attention. Or (using the Moscow street surveillance contractor recipe) if the system is smart to not be fooled by a photo - record one ideal day (or even just an hour) and put the smartphone with the video in front of the camera on repeated play. Of course the most interesting is to use counter-AI to generate video of right behavior without repetition and with matching location/street view in case if the Amazon/Netradyne AI is smart enough to have geolocation based street view integration.
- ben_w 5y agoI suspect the people who understand AI well enough to fool it also know they can get more money not being a driver.
- trhway 5y agoI think that deepfake tools will soon be available to everyday user just like filters in Instagram or basic video editing tools. And even if we just limit ourselves to tech users - some companies have long been logging coders' Eclipse (mostly not in the 1st rate countries of course), and I suspect these days that may get fed to AI. And some day it will make into US and West Europe too.
- apexalpha 5y agoYou would be surprised how quickly people can learn how to fool something, without knowing exactly how it works. Uber drivers used to look up time slots for big planes arriving at the airport. They would then all go offline on the app to trigger "surge pricing" and then all benefit from it. No one knows exactly how the algorithm works, but they know how to fool it.
- trhway 5y agointeresting aspect here is that otherwise honest people at some point of unjust pressure put on them start to allow themselves to cross into that gray zone, and without feeling shame it leads to that being done in the open inside those specific social groups affected and thus becomes the acceptable social norm there.
- bigfudge 5y agoI think people are able to segment moral behaviours very effectively. Uber’S ride allocation system would be very far down the list of things I would feel bad about gaming.
- oarsinsync 5y ago> interesting aspect here is that otherwise honest people at some point of unjust pressure put on them start to allow themselves to cross into that gray zone, and without feeling shame it leads to that being done in the open inside those specific social groups affected and thus becomes the acceptable social norm there. The thing to consider is that no actions are taking place in a vaccuum. The drivers gaming the system is not an isolated input that is occurring. Instead, there are a number of different inputs that are putting downwards pressure on the rates a driver gets to charge / how much money the driver actually takes home after costs, taxes, etc. While it's not incorrect (or even unjust) to describe the behaviour as being potentially 'gray' (although the use of colour is a different matter, I understand the sentiment being expressed), by only highlighting and focusing on the least powerful members in the system, it unconsciously paints a picture that draws focus away from the other inputs into the system that have resulted in this situation occurring in the first place.
- fortran77 5y agoWhat makes you think people who take a job driving are incapable of understanding things as well as you?
- ben_w 5y agoAs soon as someone has developed that understanding, they get a chance for a massive pay rise and better working conditions. While I acknowledge that some people will prefer to be a driver than to work in any of the places whose doors would open with this skill, I suspect this is a minority.
- a012 5y ago> can the driver just put a photo of himself in front of the camera and score total bonus for being always on attention. Or (using the Moscow street surveillance contractor recipe) if the system is smart to not be fooled by a photo - Only if you know what the AI cam sees, if it's like a blackbox to you then I doubt there's way that you could do to fool it.
- trhway 5y agoAfter partially obscuring the lenses by say an accidental drop of ketchup : "Your camera doesn't get correct image" "Why?! What is wrong?" "See for yourself"
- exporectomy 5y agoIt's hard to believe or every single driver would get the same consequences. This reminds me of drivers who complain about speeding tickets right after the speed limit changed. Well, slow down before the speed limit changes and you'll be fine. Some people just have bad habits without realising.
- laumars 5y agoThis comment reminds me of a, thankfully small, subset of developers who believe their code is infallible and it must be the users fault if the application has bugs. What the AI is attempting to solve is a complex problem. I’m willing to give the drivers here the benefit of the doubt ;)
- exporectomy 5y agoThis comment reminds me of a, thankfully small, subset of drivers who believe their driving is infallible and it must be the other drivers' fault if they're penalized. What the driver is attempting to do is a complex task. I’m willing to give the AI here the benefit of the doubt ;)
- laumars 5y agoYou clearly didn’t read the article then. The drivers are open to dialog. It’s the maintainers of the software and/or Amazon who are assuming the system is perfect. I’ve worked on smart interfaces for cars by the way. My experience not only as a driver but also as a developer in this space tells me that AI described in the article needs further development and your presumptions in this discussion are BS.
- exporectomy 5y agoYou're missing the point. If the AI is consistently penalizing drivers for looking in the mirror, then it'll affect them all equally and not be unfair. If it treats some drivers worse than others, why didn't they mention that instead of leaving us to assume that there really are drivers who are never penalized for looking in the mirror? TFA even points out drivers making excuses for not wearing a seatbelt. If they won't even take personal responsibility for their own illegal actions, of course their opinions on more subtle things like following distances aren't reliable.
- hughrr 5y agoI am living in this hell at the moment. This situation originated from compliance box ticking and trickled down to a kafkaesque nightmare where you are punished for ancillary problems. This is of course while being hammered because delivery has declined to a snail’s pace because the numerous hoops that need to be jumped through and general cruddiness of the process get in the way. But someone somewhere high up in the ivory tower ticked a box. I suspect the same here happened with Amazon and an insurer somewhere. Push the hell down to the bottom of the stack. The funny thing in this case is the process holes are still so enormous that you can drive a tank on fire through it and straight into production. The net gain is zero and the outcome is overconfidence.
- robbedpeter 5y agoTaser the camera. "Dunno, hoss, didn't notice it wasn't working. "
- mikro2nd 5y agoSpeak softly and carry a can of spray-paint. (Hairspray might work just as well and be more defensible.)
- bryanrasmussen 5y agosure, so the AI knows you're driving and it can NEVER see your face.
- sdedovic 5y agoReminds me of something that happened a few years ago to me. Company was primarily using Java for the backend. The Application Security team decided to start scanning all our deployable JARs and WARs with a static analysis tool. Well, immediately the tool started complaining about our libraries. For example, the official Elasticsearch library, for the version of the database we used, had multiple System.out.println calls. Well those were all flagged and the static analysis tool deemed our code unacceptable. We needed to use a logger, not stdout. So we had to go and take it up with AppSec. And explain, no thats not our code. Yes, it does run in production. No we can't use a different library. The whole thing was exactly as you put it, a kafkaesque nightmare where I'm being punished for something I don't understand by people who don't understand. An no-one can tell me why.
- lm28469 5y agoI think we're in a huge bubble in term of automation/AI these days, people are convinced they're very close to being able to automate most things while in reality we're faaaar away from even simple tasks. We're high on tech and the afterglow will hit hard The seemingly very smart people designing these systems don't understand that their 1 in a billion edge case happens hundred of times every single day when you scale it to the world
- bsenftner 5y agoWe're in for a few decades of poorly implemented automation, to the degree many will feel they live in a dystopian nightmare. The arrogance of our management class to think society can be automated without a society wide analysis of what that automation's unexpected side-effects are going to be is equal to the colossal disaster we're going to see. I serious feel sorry for everyone that is going to live through this period. We're gonna be creating misery for a few decades, until the assholes on top figure out this needs massive pre-planning and the seat-of-the-pants methods being used now is just setting up for a planet-wide disaster.