3 ms·
I remember reading a blog post (if someone has the link, that would be much appreciated) of an Nvidia developer who was training a model to play Pac-Man a few m
by smoldesu 6y ago
I remember reading a blog post (if someone has the link, that would be much appreciated) of an Nvidia developer who was training a model to play Pac-Man a few months ago, and they simply told the AI to avoid death however possible. They let it run through a sizable amount of iterations with expectedly poor performance, but the model eventually "learned" that it could pause the game to avoid a failure condition. Since it was one of the most successful iterations around, the entire model eventually had to be re-trained without pausing enabled to force it to perform better.
I think the ultimate moral of this story is to be careful what you wish for. We should be excited at the opportunities that AI presents, but baby steps are important right now. As this article points out, even basic image classification can be fooled with nothing more than a pen and paper. It seems a little dangerous to be incorporating this into anything mission-critical, and I suspect we'll soon see a rise in "hacks" that involve exploiting bias in machine learning.
- rjsw 6y agoOld-style AI [1] could learn how to exploit the rules of the game too. [1] https://en.wikipedia.org/wiki/Eurisko https://en.wikipedia.org/wiki/Eurisko
- evgen 6y agoWhen doing hardware evolution on FPGAs was the new hotness one of the early things people learned was that they needed to move the evolved agents around within 'territories' and even to different boards because they would learn to exploit the underlying physics and electrical characteristics of the semiconductors in the FPGA boards.
- gwern 6y agoThat might be the lexicographic Mario agent: http://tom7.org/mario/ http://tom7.org/mario/ (Checking my list & https://arxiv.org/abs/1803.03453 https://arxiv.org/abs/1803.03453 I don't see any others about pausing or stopping the game.)
- maxerickson 6y agoHalf the conversations on the internet follow that same pattern, so maybe it's a sign of burgeoning human level intelligence.
- bellyfullofbac 6y agoI look forward to "AI" being tasked to solve the climate crisis deciding its best chance of success is to kill all humans... (only half kidding)
- ce4 6y ago"A strange game; the only winning move is not to play."
- elipsey 6y agoOne of my professors also taught an undergrad intro AI class. He told me a story about a student who got some of their goal conditions wrong, and later returned to find that they had trained an agent to lose at several board games with astounding efficiency, and that it was strangely impressive to watch how quickly it could lose to other agents, or to see how adroitly it could lose to a human player, even a willfully un-competitive one. I lacked the imagination and experience at the time to recognize any implied object lesson beyond programming more carefully.
- cafard 6y agoP.J. Plauger wrote of a co-worker who got a condition wrong for a checkers-playing program, so that it could be beaten by novices, including small children. The programmer also neglected to program it for the possibility of loss, so that at some point it would flood the board with newly created checkers. Plauger said, If you think the kids enjoyed beating the program, you should have seen how much they enjoyed making it cheat.