5 ms·
I'm always wondering at the safety measures on these things. How much force is in those motors? This is basically safety-critical stuff but with LLMs. Hallucin
by causal 2y ago
I'm always wondering at the safety measures on these things. How much force is in those motors?
This is basically safety-critical stuff but with LLMs. Hallucinating wrong answers in text is bad, hallucinating that your chest is a drawer to pull open is very bad.
- cess11 2y agoNot a big deal on the battlefield.
- rizky05 2y ago[dead]
- causal 2y agoI'd say a very big deal when munitions and targeting are involved
- cess11 2y agoWhy do you think that? Battle fields are violent and exhausting, people get the shakes, make mistakes, hurt themselves and each other all the time. Munitions are generally designed to not explode from a bump in the road or getting dropped or squeezed, and targeting systems commonly support automatic tracking or similar, for this specific reason.
- silentwanderer 2y agoIn terms of low-level safety, they can probably back out forces on the robot from current or torque measurement and detect collisions. The challenge comes with faster motions carrying lots of inertia and behavioral safety (e.g. don't pour oil on the stove)
- mmh0000 2y agoThe thing in the video moves slower than the sloth in Zootopia. If you die by that robot, you probably deserve it.
- causal 2y agoAre you saying it cannot move faster than they because of some kind of governor?
- Symmetry 2y agoA governor, the firmware in the motor controllers, something like that. Certainly not the neural network though.
- UltraSane 2y agoThat is how I would design it. It is common in safety critical PLC systems to have 1 or more separate safety PLCs that try to prevent bad things from happening.
- idiotsecant 2y agoAlthough in a SIL safety system the dangerous events are identified and extremely thoroughly characterized as part of system design. There cannot be a safety system of this type for a generalist platform like a humanoid robot. It's possibility space is just too high. I think the safety governor in this case would have to be a neural network that is at least as complex as the robots network, if not more so. Which begs the question: what system checks that one for safety?
- UltraSane 2y agoLimiting max force applied CAN be can be characterized for this robot.
- throwaway0123_5 2y agoAs a sibling comment implies though, there's also danger from it being stupid while unsupervised. For example, I'd be very nervous having it do something autonomously in my kitchen for fear of it burning down my house by accident.
- exe34 2y ago
- UltraSane 2y agoYou can have dedicated controllers for the motors that limit their max torque.
- imtringued 2y agoThat's not enough. When a robot link is in motion and hits an object, the change in momentum creates an impulse over the duration of deceleration. The faster the robot moves, the faster it has to decelerate, the higher the instantaneous braking force at the impact point.
- UltraSane 2y agoThen limit max velocity.
- rtkwe 2y agoThat's actually more of a solved problem. Robot arms that can track the force they're applying and where to avoid injuring humans have been kicking around for 10-15 years. It let them go out of the mega safety cells into the same space as people and even do things like letting the operator pose the robot to teach it positions instead of having to do it in a computer program or with a remote control. The term I see a lot is co-robotics or corobots. At least that's what Kuka calls them.
- Symmetry 2y agoThat's fine for wheeled robots or robots bolted to the floor but for legged robots, especially bipeds, the hard question is how to prevent them from falling over on things. These don't look heavy enough to be too dangerous for a standing adult but you've still got pets/children to worry about.