7 ms·
You'll find pretty quickly that the exact techniques that worked so well in learning to play Atari games very often fail spectacularly when you have to introduc
by deong 9y ago
You'll find pretty quickly that the exact techniques that worked so well in learning to play Atari games very often fail spectacularly when you have to introduce goal-steering.
Reinforcement learning turns out to be fantastically clever at finding really stupid solutions if you give it the tiniest opening to do so. You put a camera in a room to provide feedback for an agent to learn to move an object closer to the camera, and it will happily learn to knock the camera over.
- AnIdiotOnTheNet 9y agoTo be fair to our AI brethren, this is true of Humans too. I watch people game metrics every single day, and many of them fail spectacularly when presented with real world problems outside of their experience.
- jacobush 9y agoGaming metrics is the very soul of corporate life
- _emacsomancer_ 9y agoThen which is real and which illusion?
- jacobush 9y agoGood question. Sometimes, the metrics must be gamed to make real progress. (As opposed to the more usual gaming them for personal gain.) Between these two, some self serving bias and delusion, mission statements etc.. what is real?!
- taneq 9y agoIf they meet the spec, they're not stupid solutions, it's a stupid spec.
- candiodari 9y agoUnfortunately, when gaming metrics has real world consequences (and this is of course the whole point of those metrics, assuming they're not gamed), then things like 2008 happens, and tens of thousands of people lose their homes.
- deong 9y agoThe problem is that we generally rely on human intelligence to fill in gaps in specs that are really not stupid for a human. AI will exploit gaps that a human would basically say aren't there until they see evidence to the contrary. So we can say that's a bad spec if we like, but what's the answer that leads to? I don't need an AI if I can just declare all users must be really good programmers spending their days writing unambiguous specs. That wasn't really the goal of the AI though.