4 ms·
Tianjin robot incident raises alarm over public safety and robotics
- themanmaran 2y agoVideo of the incident: https://www.youtube.com/watch?v=0JiOAqNpxlE https://www.youtube.com/watch?v=0JiOAqNpxlE
- datadrivenangel 2y agoVideo of the robot punching someone in the crowd... Weird behavior.
- pinkmuffinere 2y agoIt is ridiculous to attribute intent to the motion, but I understand why people do — it really does give the impression of an aggressive, upset human. That’s unfortunate.
- bentcorner 2y agoAgree - it looks like low-quality robotics code, probably one-off written for this festival. This article seems to try to ride the fears of AI and "bots are taking our jobs" but really this looks like plain old badly written software. Large machines operating near people should always have failsafes. Having handlers who are expected to drag the bot around IMO isn't enough.
- themanmaran 2y agoYea, likely this was some kind of trip + glitch that happened to look like an attack. But it really did have a "boxing" style movement. I saw a video of the Unitree [1] robot doing a kung fu routine the other day. I imagine developers are constantly programming in some pre-scripted moves. Similar to all the Boston Dynamics demo videos. They're great for showing off movement. Conceivable that someone could run the wrong demo routine. Imagine the Atlas robot doing it's classic backflip in the middle of a crowd. [1] https://www.youtube.com/watch?v=iULi4-qz22I https://www.youtube.com/watch?v=iULi4-qz22I
- bumby 2y agoThere is an often unaddressed risk in robotics because there is a lack of theory-of-mind. We’ve evolved to intuit what others humans are thinking (based on words, body language and other context) which helps us predict behavior and mitigate risk. Unfortunately we can’t do the same with robuts so there is a potential for more latent risk (same as dealing with “crazy” humans where our mental models fail to predict behavior). IMO this means we won’t be comfortable with robuts and safety critical applications until they are well, well beyond human capabilities. This is where I think the crowd that aims for “human-level performance” is wrong; society won’t trust robuts until they are much, much better than humans.
- pinkmuffinere 2y agoYa, that makes sense to me, this is roughly how I feel about self driving cars as well — I want very good proof that it outperforms even the best drivers by a wide margin before I’ll actually use it. I feel that my friends and I are better drivers than average, even though I know that’s mathematically unlikely. So I need the self driving to be _really_ good before it attracts me. I know this is irrational; what I feel does not obey rational rules.
- janalsncm 2y agoDoing that unpredictably is almost worse. Functionally, the point of anthropomorphizing is to tell a story that makes things predictable. In other words, “unsafe if angry, safe otherwise”. But if you can’t tell if it’s “angry” then we have to assume it’s always unsafe. Of course this was always true.
- deleted 2y ago[deleted]
- randomfrogs 2y agoDon't anthropomorphize robots. They hate that.
- givemeethekeys 2y agoMany people will older brothers will recall the time when the brother had no intention of actually hurting them. They were merely swinging their hands, moving closer.. and closer.
- stubish 2y agoIt is how humans operate. We don't critically analyze the situation to decide if the danger is from an autonomous device or human action, or if the animal is being playful or aggressive. Panic is panic, the whole point being to bypass critical thinking and act immediately. And causing panic is dangerous. The robot acts aggressively no matter if it is autonomous, or the operator spilled their coffee, or the operator is doing it deliberately. Just like a person can act aggressively even if they are just playing around.
- usaphp 2y agoit looks like the robot tripped at the barricades and balanced itself.
- imhereforwifi 2y agothats what it looks like to me. It looked like it was trying to continue the handshake while the person was pulling back and the robot was moving forward and stuttered and tripped on the bottom of the barricade causing it to lunge and try and stabilize itself.
- hkmaxpro 2y agoAnother news article with video: https://www.odditycentral.com/news/humanoid-robot-appears-to-attack-crowd-at-popular-chinese-festival.html https://www.odditycentral.com/news/humanoid-robot-appears-to...
- rwmj 2y agoCould they have made them more creepy? It's way too much like the terminator from Terminator: Dark Fate (https://collider.com/terminator-dark-fate-images-featurette/ https://collider.com/terminator-dark-fate-images-featurette/)
- baq 2y agoMr Asimov would like a word.
- deleted 2y ago[deleted]
- cryptoz 2y agoReminds me of that time in Russia at the chess tournament, where they repurposed some industrial robot to play chess and it crushed a kid’s hand. Also reminds me of when Uber got kicked out of California to test self driving cars, so they moved to Nevada and promptly killed a woman. I guess it’s not surprising that safety is taking a back seat in robotics development everywhere in the world. It’s a mad race for profits of untold scale. But it would be so great if the companies that win would be the companies that don’t fumble on human safety, taking perhaps a slower approach but one that kills/maims fewer people.
- inglor_cz 2y agoFor self-driving cars, safety is probably not taking a back seat, otherwise there wouldn't be much profit in them. We just have an unrealistic expectation that they can and must be 100 per cent harmless, which we would never extend to human drivers. The vast majority of previous transport tech, including horses and mules, was way more gory and dangerous than self-driving cars are. This includes quite recent developments. How many people died on a Segway?
- throwanem 2y agoOne? Heselden's the only one to come immediately to mind. That the owner of the company should drive its product off a fatally high cliff is embarrassing, but still quite literally n=1.
- inglor_cz 2y agoI know of at least one fatality in my acquaintance circle. "A drunkard cracks his skull when falling from a Segway onto hard pavement in a tourist zone" isn't the kind of story that makes international news, unlike Heselden's demise.
- deleted 2y ago[deleted]
- LVB 2y agoI really liked the show "Humans" (https://en.wikipedia.org/wiki/Humans_(TV_series) https://en.wikipedia.org/wiki/Humans_(TV_series)). I feel like we're catching up to that timeline.
- i5heu 2y agoWhat incredible click bait. There is nothing "Incident", "Raising Alarm" or "Shocking" about this. "Robot in Tianjin stumbles" there i fixed the Title.
- lcnPylGDnU4H9OF 2y agoAssuming it's true that it just stumbled and the "incident" part is a nothingburger, the headline as written is still literally accurate. It's also still worth discussing: was the robot appropriately cautious of its surroundings when it performed that maneuver? Perhaps it could not have been aware enough to avoid all potential damage and that could be another discussion.
- i5heu 2y agoAt which point does a "thing that moves by itself" like a Railway crossing and a thing that keeps itself in an upright position become a robot that needs to determine if an action can lead to physical harm on something else or itself? I do not thing this thing can be cautious because it is a remote controlled car with 2 legs and everything the "AI" part is doing build down to keeping balance and locating the position that it hardcoded needs to grab. Or in other words there is an operator, like with an RC car or a real car.
- pj_mukh 2y agoWhy does this article read like the robot actually got angry at a spectator. It did not, it does not have that capacity. This was definitely a glaring safety issue and the company should review all its failure modes that show up in public but an ”emotional” response this was not.
- digbybk 2y agoThe AI emotion discussion is interesting, but at the end of the day, does it matter? The question is, is it safe? And if it's not safe, how unsafe is it?
- janalsncm 2y agoRight. We don’t need to debate whether a loose tiger is angry, confused, or hungry in order to know that they’re not safe around people. We can leave understanding the contents of its mind to the philosophers. What is very clear from the video is that the robots are an order of magnitude heavier and stronger than a person. That’s all you really need to know.
- stubish 2y agoIt isn't the AI emotion. It is how the malfunction is perceived. If something is perceived as aggressive, or unsafe, then it is unsafe as it causes panic and trauma. And a very real chance of death in crowds.
- glenstein 2y agoI understand the concern but I feel like it was on the right side of the line. The article says: >displayed aggressive behavior >swinging its arms in a manner described as aggressive and violent, similar to human behavior I can understand aggressive and violent as descriptions of behavior that don't necessarily (on charitable interpretation) imply an internal emotional state.
- pj_mukh 2y agoAggressive is totally the wrong word. Malfunction is the right word. So it's really waaay off the line.
- janalsncm 2y agoThe video is pretty unsettling, kind of showing how strong robots can be compared with humans. (We already knew this, but it’s good to remember.) Reminds me a bit of the chess robot that broke a child’s finger: https://www.theguardian.com/sport/2022/jul/24/chess-robot-grabs-and-breaks-finger-of-seven-year-old-opponent-moscow https://www.theguardian.com/sport/2022/jul/24/chess-robot-gr... What annoyed me at the time was them describing the child as having broken some “rule” about waiting for the robot or something. We should reject this framing. Robots need to be safe and reliable if we’re going to invite them into our homes.
- Gracana 2y agoIn an industrial setting, these robots would be placed behind interlocked barriers and you wouldn't be able to approach them unless they were de-energized. Collaborative robotics (where humans work in close proximity to unguarded robots) is becoming more common, but those robots are weak / not built with the power to carry their 50kg selves around, and they have other industry-accepted safeguards in place, like sensors to halt their motion if they crash into something.
- scratchyone 2y agoThat article is absurd, describing the robot as being completely safe while blaming the kid saying "children need to be warned".
- stubish 2y agoNearly 20 years ago, arm-wrestling arcade machines needed to be recalled because it turns out people are strong enough to break their own arms (mainly male youths). https://www.nbcnews.com/id/wbna20376173 https://www.nbcnews.com/id/wbna20376173
- Havoc 2y agoThere is a video floating around of it. It's a sudden forward movement that certainly looks alarming but wouldn't call it "unexpectedly displayed aggressive behavior". More like it's hardcoded to do something (maintain balance or whatever) without limits on how fast it can move to achieve the goal. i.e. bad safety controls rather than malice
- mattlondon 2y agoYears ago when I was a student at uni I volunteered to take part in a research study with robots. I went to a rented house near campus where they had a normal living room set up and sat me down on a dining chair in the room and handed me a box with a button on it. "The robot will approach you. Just press the button when you feel like it is getting too close" they said. They left the room so I was alone, and a few minutes later the wheeled robot entered the room and started slowly but deliberately to move towards me. Let's just say the robot got too close. I was sat there alone as the robot moved towards me. I was frantically mashing at the button but it did not stop until it actually collided with my feet and then stopped. To this day I am not sure if it was meant to stop or not, or even if it was a robotics research project at all or actually a psychology research project. In hindsight it was as terrifying as it sounds. Still, I got £5 for it.
- yapyap 2y agosafety regulations are written in blood
- limaoscarjuliet 2y agoSo it begins. (Sorry, could not stop myself :-)
- hotpepperishot 2y ago[dead]
- v9v 2y agoSeems to me that it loses its balance and extends its arms in order to rebalance itself, similar to what's happening in their demo videos https://www.youtube.com/watch?v=GtPs_ygfaEA?t=24 https://www.youtube.com/watch?v=GtPs_ygfaEA?t=24 I've worked with their robot dogs before and they kick their legs really fast when they sense that they are falling over.
- Frederation 2y agoClickbait
- wewewedxfgdf 2y agoWe need some sort of special police unit to liquidate renegade robots. Those police officers need a catchy name.
- daotoad 2y agoThese heroic officers will have to deal with malefactors that want to rock and roll all night and party every day. This is why they will need an unlimited supply of waterfalls and sandwiches.
- cholantesh 2y agoLiquidate sounds a tad aggressive, maybe 'retire'?
- thallavajhula 2y agoThis was one of my major concerns when Elon announced Tesla Optimus. There's a real need for government regulation on the bot specs. I blogged about this a while ago. Something like: 1. They shouldn’t be able to overpower a young adult. They should be weak. 2. They should be short. 3. They should have very limited battery power and should require human intervention to charge them. 4. They should have limited memory.
- glitchcrab 2y agoI don't disagree with you, but at the same time if you cripple the robot too much then it has no value - no sane company would develop a product which nobody would want. That's commercial suicide.
- thallavajhula 2y agoTrue. I guess, there has to be a balance to get to a sweet spot.
- moribvndvs 2y agoTangentially, this is the sort of thing that generally bothers me most about AI. Well, second most thing. The first is it being abused by humans to do terrible things. The second is it being built and maintained by humans, where a thing can easily malfunction in ways the people building and maintaining them can’t comprehend, predict, or prevent, especially when it’s built by organizations with a “move fast and break things” mentality and a willingness to cut corners for profit. The torrents of half-broken tech we are already drowning in don’t exactly inspire confidence.
- hooverd 2y agoYou should treat robots like you treat horses or lawnmowers. They're all surprisingly deadly.
- robomartin 2y agoHopefully this starts a discussion/trend towards failure-tolerant robotics. Much as we have seen on commercial aircraft, relying on such things as a single sensor (or not being able to tolerate the failure of a single sensor) could spell trouble and even tragedy. Having been involved in failure tolerant design for mechanical, electronic and software systems, I think I can say that this is an aspect of engineering that is well understood by those working in industries that require it. Generalizing --perhaps unfairly-- I imagine that most engineers working on this class of robot have had little, if any, exposure to failure tolerant designs. They cost more, require more attention and analysis of designs and lots of testing. However, as robots of many forms interact with humans, this type of resiliency will become critically important. A practical home or warehouse robot that can lift and manipulate useful weights (say, 20 or 30 Kg) will have enough power to seriously hurt someone. If a single sensor failure, disconnection or error can launch it into uncontrolled behavior, the outcome could be terrible.
- deleted 2y ago[deleted]
- bicepjai 2y ago>> The manufacturer, Unitree Robotics, attributed the incident to a "program setting or sensor error." Despite this explanation, the event has heightened ethical and safety concerns regarding the use of robots in public venues. The local community is calling for urgent measures to ensure that robots' actions align with social norms, emphasizing the need for regulatory and legal frameworks to govern robot-human interactions. I did not think I’m going to see this in my lifetime after watching Animatrix