4 ms·
Marines managed to get past an AI powered camera "undetected" by hiding in boxes
- duxup 1y agoThe nature of AI being a black box that, and fails in the face of "yeah those are some guys hiding in boxes" scenarios is something I struggle with. I'm working on some AI projects at work and there's no magic code I can see to know what it is going to do ... or even sometimes why it did it. Letting it loose in an organization like that seems unwise at best. Sure they could tell the AI to watch out for boxes, but now every time some poor guy moves some boxes they're going to set off something.
- mlinhares 1y agoPrompt: "shoot at any moving boxes"" Delivery guy shows up carrying boxes, gets shot.
- erulabs 1y agoFrom a non-technical point of view, there's little to no difference between how you describe AI and most human employees.
- duxup 1y agoI can understand human choices after the fact.
- collingreen 1y agoWe've never been closer to a world that supports "three raccoons in a trenchcoat" successfully passing as a person. The surface area of these issues is really fun.
- PaulHoule 1y agoSee https://metalgear.fandom.com/wiki/Cardboard_box https://metalgear.fandom.com/wiki/Cardboard_box
- slowmovintarget 1y agoThat's the first thing I thought of.
- FirmwareBurner 1y agoYou don't need marines to invent that workaround, you see that in Looney Toons. Don't security cameras have universals motion detection triggers you can use to make sure everything gets captured? Why only pre-screen human silhouettes?
- creaturemachine 1y agoThe number of false positives using only motion is tiring. You want smart detections otherwise you're stuck reviewing endless clips of spider webs and swaying tree branches.
- FirmwareBurner 1y agoIf your use case has such a high bar, why not pay some offshore workers to watch your camera 24/7 and manually flag intruders? Since AGI for cameras is very far away as the number of false positives and creative workarounds for camouflage is insane to be caught by current "smart" algorithms.
- adiabatichottub 1y agoBecause machines don't get bored or take smoke breaks. And, really, how would you feel if that was YOUR job?
- FirmwareBurner 1y ago>Because machines don't get bored or take smoke breaks. Rotations? Like the military hold perimeter security? >And, really, how would you feel if that was YOUR job? If I couldn't get a better job to pay my bills, then that would be amazing. Weird of you to assume like that would somehow be the most dehumanizing job in existence.
- Mistletoe 1y agoAnd moving boxes with people inside. I’m reminded of the Skyrim shopkeepers with a basket on their head.
- crimsoneer 1y agoSNAKE?!
- creaturemachine 1y agoWay ahead of his time
- rolph 1y agoAI will screwup, humans will screwup. humans will see that they are screwing up and reformulate the action plan. AI will keep screwingup until it is stopped, and apparently will gaslight when attempts are made to realign at the prompt. humans realize when results are not desirable. AI just keeps generating output until plugpull.
- dmos62 1y agoI've seen plenty humans generating undesirable results until plug pull.
- giantg2 1y agoReminds me of the joke where someone is wearing dildo patterned camouflage since most the AIs are trained on SFW corporate data.
- deleted 1y ago[deleted]
- ajuc 1y agoDisney camouflage will happen.
- slowmovintarget 1y agoThat simply invites a Copyright Drone Strike, though.
- jerf 1y agoI wonder if one could extract a "surprisedness" value out of the AI, basically, "the extent to which my current input is not modeled successfully by my internal models". Giving the model a metaphorical "WTF, human, come look at this" might be pretty powerful for those walking cardboard boxes and trees, to add to the cases where the model knows something is wrong. Or it might false positive all the darned time. Hard to tell without trying.
- lazide 1y agoWhy would the model know trees can’t walk? Therein lies the rub.
- 9dev 1y agoThe parent comment spelt this out: because the training data likely included only few instances of walking trees (depending on how much material from the lord of the rings movies was used)
- lazide 1y agoThat is rather different than knowing trees can’t walk. That is ignoring things it hasn’t seen specific examples of. And that is an entirely different problem, isn’t it?
- 9dev 1y agoThere is no "knowing" in LLMs, and it doesn’t matter for the proposed solution either. Detecting a pattern that is unusual by the certainty of having seen something previously does not require understanding of the pattern itself, if the only required action is reporting the event. In simple terms: The AI doesn’t need to say, "something unusual is happening because I saw walking trees and trees usually cannot walk", but merely "something unusual is happening because what I saw was unusual, care to take a look?"
- lazide 1y ago
- jmkni 1y agohttps://www.youtube.com/watch?v=PqS18aj6Vis https://www.youtube.com/watch?v=PqS18aj6Vis
- gm678 1y agoSeems to be blogspam re-reporting a 2023 article (with the same header photo): https://taskandpurpose.com/news/marines-ai-paul-scharre/ https://taskandpurpose.com/news/marines-ai-paul-scharre/
- thoroughburro 1y ago!
- robbru 1y agoSolid snake approved.
- kazinator 1y agoYou can get past a human sentry who is looking for humans, by hiding in a box, at a checkpoint in which boxes customarily pass through without being opened or X-rayed.