11 ms·
Artificial Intelligence Uses Videogame Footage to Recreate Game Engine
- egypturnash 9y agoIt sounds like the only input is video. Video plus the user's controls might be much more interesting; there's a huge archive of input recordings available at tasvideos.org that could conceivably be used as a source, rather than making people actually play the damn things. Or you could just take some of the other AIs designed to play games based on video and wire them up. Then just let your system learn to play AND run Mega Metroid Brothers.
- zardo 9y ago>Then just let your system learn to play AND run Mega Metroid Brothers. One of the many games on the triangle with vertices Mega Man, Super Metroid, and Mario Brothers?
- ticviking 9y agoI'd play something in that space. At least to see if it is good.
- ced 9y agoThe paper says that the input is video + the set of sprites used in each game. This simplifies the problem quite a bit. I tried to work from screenshots of Mario to recover the sprites, and it was a surprisingly challenging problem.
- ZirconCode 9y agoI don't have any experience in the field, but reading the paper, it seems impossibly weak and almost useless. This should only work for a very limited type of game, in which case it will never help anyone speed up game construction more than a simple sprite engine. It seems more an exercise in using openCV. What am I missing here, because I'm positive that I am missing something?
- wmccullough 9y agoYou're missing that not everything has to be a breakthrough. Sometimes fun research experiments are just cool and fun. I didn't get the impression that they were overselling the research.
- AstralStorm 9y agoSure they are, "recreate game engine" when it actually is "optimally match a database of cooked if-then rules with simple linear functions". For one Mario level. Taking 2 weeks of runtime to learn it. The set of facts is worthless for anything of complexity. It does not really generate the rules itself. (They are directly derived from the facts.) What they did is only a small improvement over a typical expert system or CNN for a very limited case. Choice quote: "Notably each fact can be linked back to the characteristics of a sprite that it arose from." Wrong. When you pick up a flower your sprite changes, but how does it know you can suddenly shoot bullets? Etc. And for more complex games a lot of data requires exploration well past the GUI. An action might change acceleration (suddenly nonlinear ice physics with momentum), or direction handling, or you can start flying, or many other things. What if the thing moves in a circle? What if there is just some probability that something results? The approach will fail at modelling as soon as Mario level 1-4. (The one with rotating fireballs.) Or produce an insane representation of the engine. Note how it even cannot model the dampened triangle wave motion of the fireballs in the example - assumes they're a sparse line. The paper presents no way to reduce these huge number of "if-then rules" to something actually useful either. Since this doesn't even attempt to explore the state space, it also requires a huge database. Calling this "recreate game engine" is akin to saying that since we have an algorithm that can solve checkers, it will solve poker, go and also whodunit. And can play Jeopardy too. I even suspect it's not useful as a preprocessor to something that can actually play a game, as it will break later cases.
- nafey 9y agoPeople generally are willing to forgo the cost/benefit analysis of a machine learning solution. There is an abiding faith in future improvements in cost although I am not so sure anymore.
- stephengillie 9y agoThis is reminiscent of the Tribes 2 development, when the developers revealed they lost the original Tribes source code, and thus the physics calculations. Beta testers constantly complained that falling didn't feel right, jetting and skiing (the game's main movement) was slow and soupy. Players were leaking videos and photos showing the differences in motion. At one point, Dynamix hired a top player to playtest, as he "remembered the best" how it felt. All to reclaim the physics calculations of some game from the Leisure Suit Larry company.
- endgame 9y agoI'm not surprised, because get things lost to history all the time, but do you have a source?
- deleted 9y ago[deleted]
- deleted 9y ago[deleted]
- drawkbox 9y agoYeah I could see using this to match physics and gameplay feel for games. Their example uses MegaMan physics and is quite close. It might be a good analysis tool as well to make sure gameplay tweaks to physics, lighting, etc between versions or when comparing changes almost like a gameplay diff.
- ramses0 9y agoAs a matter of fact, there is still a regular group of Tribes2 players online. This past Memorial Day weekend, I booted up a VM, d/l'd the ISO's, etc. and played a capture the flag match for a few hours... eventually with 16+ on the same server. The game is 16 years old... old enough to drive a car and it's still being played!
- archagon 9y agoKiller soundtrack, too!
- Upvoter33 9y agomore AI theater. there will be a moment in about five years when people are like "what happened to all that stuff about auto-driving cars, evil AI, etc.?"
- red75prime 9y agoSiri, what happened to all that AI nonsense from 5 years ago? I'm sorry, Dave, I'm afraid I can't answer that.
- bllguo 9y agoThe algo learned about the underlying rules of its environment - the physics - by watching video. Imagine applying this to more complex games, and then to the real world (the ultimate game!). Cool approach; to me it seems to really resemble how people learn in real life.
- deleted 9y ago[deleted]
- jordache 9y agothe examples had the character move precisely like in the reference video. This just looks like the AI recorded the original video and played it back. I thought the AI created a playable game engine from the reference video? If so, why did it need to replicate the exact movement of the game character? Why not come up with its unique set of movements in a fully flexible game engine?
- kilceem 9y agoMaybe that was just to show the recreation. An engine is pure code and a lot of times closed source. Just creating animation and similitude in that ways does not recreate a engine but could create those aspects. Engines have many aspects of game mechanics many you do not really see directly but as a byproduct.
- jordache 9y agoBut the impressive sell of this technique was the AI discerned enough patterns and physics from the reference video to auto generate a game engine that replicated/simulated the original game. This alludes that it understood the player character and now can control the sprite representing the player character via unique paths through the game map. It's waaaayy less impressive if it's just programmatically processing video frames, tracking pixels to generate coalescence, generating a library of sprites based on pixel coalescence, and then playing back the same sequence of sprites programmatically...
- Phait 9y agoSeriously, tech journalism needs to get it's shit together because it's becoming annoying. If I see another article about a mediocre algorithm presented as AGI, I'm gonna start posting on my blog about how every failed experiments is really Skynet being lazy in its teenager years
- Phait 9y agoIts* Stupid autocorrect
- deleted 9y ago[deleted]
- Bartweiss 9y agoAgreed, although I think this case shows a different problem - it's not a tech news site but a university press release. University press has a horrible tendency to oversell research in the name of getting news coverage, often completely burying possible flaws or limitations of the result. The University of Maryland infamously put out a major release on concussion treatment based on a study that didn't exist (1). Similar but lesser abuses appear to be almost constant. It seems like worthwhile-but-unspectacular thesis result gets spun as a groundbreaking insight in its field. 1: http://nymag.com/scienceofus/2016/01/chocolate-milk-concussion-scandal.html http://nymag.com/scienceofus/2016/01/chocolate-milk-concussi...
- daralthus 9y agoThey wrote a blog post a couple of month ago with more details: https://medium.com/@mark_riedl/automated-game-understanding-e8c9107c5ac2 https://medium.com/@mark_riedl/automated-game-understanding-...
- bennysince86 9y ago"The technique relies on a relatively simple search algorithm that searches through possible sets of rules that can best predict a set of frame transitions" so, their script/app doesn't reproduce a game engine at all, it instead analyzes pixel arrays from video frames and maintains rules about how the pixel arrays typically transform from one state to another. this sounds more like a useful video analytics tool than an "AI that makes game engines". if i was responsible for the headline/marketing, i would've gone with "Artificial Intelligence Can Predict the Ending of a Movie" or something (as long as the movie is 8-bit and only has 256 possible colors!) in other words i dont think Unreal or Unity are worried about this tech.