3 ms·
I don't make the apocalyptic predictions about AI that everyone else seems to. But there is a simple fact that anyone in IT has run into. Google (as an example)
by kjrose 6y ago
I don't make the apocalyptic predictions about AI that everyone else seems to. But there is a simple fact that anyone in IT has run into. Google (as an example) has a massive amount of money and spends it extensively to try and prevent fraud and issues with their various services.
In the process, there is story after story of someone losing their entire Google history, being blocked from Google Ads, Mail, etc. all because some automated system kicked in and decided they were a problem. Since Google doesn't have any reasonable appeals process this usually turns into a kafkaesque hell for people who experience it.
Now imagine you put that exact same computer system in control of sniper rifles and drones that can kill someone.
Yeah. It's not an ethical dilemma, it's a hellish reality.
Let's wait until Google (or someone with essentially an unlimited supply of money) can figure out how to make it so that they can run their own services without randomly killing people digitally before we start to kill people in real life with those same tools.
- onion2k 6y agoAutonomous weapons don't decide whether or not to kill someone based on subjective moral criteria. They're dumb. They don't discriminate. They're essentially just working on a model that looks like "kill any human within this virtual fence". Building in features that try to be clever is unnecessary and complicated. You just need a sign that says "Don't go in here."
- kjrose 6y agoUntil the day that it messes up and thinks that a certain area outside the fence is within the fence.
- Nasrudith 6y agoThe warnings/fences should be placed past its range limits anyway if done properly given overpenetration and missed shots. Of course friendly fire also should not happen.
- oconnore 6y agoThis feature is ready to ship, our data shows that over 99.2% of hikers correctly interpret our fence boundaries!
- rasz 6y agoSooner or later someone will get frustrated with the no-appeal treatment and go all Matt Damon (Elysium) directly after the management.