15 ms·
AlphaStar interacted with the StarCraft game engine directly via its raw interface, meaning that it could observe the attributes of its own and its opponent’s v
by modeless 8y ago
AlphaStar interacted with the StarCraft game engine directly via its raw interface, meaning that it could observe the attributes of its own and its opponent’s visible units on the map directly, without having to move the camera - effectively playing with a zoomed out view of the game
Additionally, and subsequent to the matches, we developed a second version of AlphaStar. Like human players, this version of AlphaStar chooses when and where to move the camera, its perception is restricted to on-screen information, and action locations are restricted to its viewable region.
I was really curious whether they would attempt moving the camera like a human. Sounds like it's still a work in progress, but very exciting! Even this isn't enough to make it fully like a human player, as I believe it is still getting numerical values for unit properties rather than having to infer them from the pixels on the screen. But it seems possible to fix that, likely at the cost of drastically increasing the training time.
The benefit of using pixels, of course, would be that the agent would become fully general. It would probably immediately work on Command & Conquer, for instance, while the current version would require deep integration with the game engine first. But I think the training time would be impractically long.
- aerovistae 8y agoyeah I was disappointed to discover it worked this way. don't get me wrong, it's a major accomplishment in AI regardless, but it's a significant advantage and it would be easier for me to appreciate the AI's skill if I didn't have to keep reminding myself that it can see the whole map at once. it's such an information advantage.
- shawnz 8y agoIt sounds to me like, although it could see the whole map at once, the fog of war was still applied. So the bot really just got as much information as the minimap would normally give a human player. > it could observe the attributes of its own and its opponent’s _visible units_ on the map directly
- aerovistae 8y agoNo, not true. Just had an extended argument with a friend over this. Here are some of my arguments against what you're saying: 1. While it's true that a human player could see everything the AI is seeing, the human player has to spend time and clicks to go see those things, whereas the AI sees it all simultaneously without having to use any actions or spend any time to take it in. 2. Emphasis on the computer seeing it all simultaneously. The computer can see the state of two health bars on opposite sides of the map at the same time, or 100 healthbars in a hundred places at a time. A human cannot do that, and even trying to move the view around fast enough to do so would render it impossible to actually do anything else. 3. If it's true that seeing more at once is not advantageous, then it must also be true that seeing less at once is not disadvantageous. So by that reasoning a player playing on a 1 inch x 1 inch screen would not have any disadvantage, since after all they're getting just the same amount of information as long as they move the screen around enough! Reducto ad absurdum, a player with a 1 pixel x 1 pixel screen has no disadvantage either, because they have access to the same information as long as they move around quick enough. It quickly becomes evident that smaller screens inhibit your knowledge of the game state, and therefore larger screen benefit your knowledge of the game state.
- ocdtrekkie 8y agoThis is why a lot of competitive games have rightly decided not to support ultrawide monitors. Being able to observe more of the game map simultaneously is a huge advantage. The only fair way to support them would be to cripple the player, by cutting off the top and bottom of the viewable range, not by extending the left and right range.
- gknoy 8y agoOne thing they said early on in the ~2 hour video I was watching was that, while AlphaStar had access to the full data of everything within its fog of war, it seemed to need to partition its access to it, in a way that was similar to a human checking different screens, and did so about ~30 (or was it 37?) times per minute. This might be why changing to having to observe only one screenful at a time (rather than the zoomed out view) didn't seem to have as large an effect.
- tanilama 8y agoActually, I would say this might be the strength of AI from another perspective: the ability to observe and monitor global information without losing attention. Or in other words, attend to the whole picture from get go without being overwhelmed. While it is an unfair advantage in competitive gaming, but in more realistic settings, there is no requirement that AI needs to have only 2 eyes. It can have as many as it could handle, while human can't scale the same way.
- hughzhang 8y agoWhile that would be amazing if true, I'm pretty sure if you take away the stalker blink micro AlphaStar loses hands down to humans. This isn't taking away from Deepmind's victory at all, but I think micro was what made the AI come out ahead in this one. In many of the games, Mana had much better macro only to lose to blink stalkers.
- CydeWeys 8y agoYou play the game as it's written. Come back with another version of StarCraft that isn't so micro-intensive and we can see how the AI does on that. Chess and Go don't have any form of micro and AIs are nevertheless dominant there. I'd say, give AI development another year and I wouldn't expect there to be any kind of game, in any genre, that humans can beat AIs at. Whether it's Chess, Go, other classical board games, Civilization, MOBAs, RTSes, FPSs, etc.
- celeritascelery 8y ago> Chess and Go don't have any form of micro and AIs are nevertheless dominant there. Yes, but chess and go have a tiny problem space compared to something like Starcraft. People want to see an AI win because it’s smart, not because it’s a computer capable of things impossible for humans. If the goal was perfect micro they could write computer programs to do that 10 years ago.
- CydeWeys 8y ago
- alexbeloi 8y agoYou'll likely be happy to hear that this has been (is being) addressed. I watched the live broadcast of this announcement where they did a recap of all 10 previous matches (against TLO and Mana) and they talked about this concern. During today's announcement they presented a new model that could not see the whole map and had to use the camera movement to focus properly. The deepmind team said it took somewhat longer to train but they were able to achieve the same levels of performance according to their metrics and play-testing against previous version. However... They did a live match vs LiquidMana (6th match against Mana) against the latest version (with camera movement) and LiquidMana won! LiquidMana was able to repeatedly do hit-and-run immortal drop harassment in AlphaStar's base, forcing it to bring troops back to defend its base, causing it to fall behind in production and supply over time and ultimately lose a major battle.
- kirrent 8y agoThe live game that was just played was against this version of AlphaStar. Mana did win, but it was by exploiting some poor defense against drops and hard countering the stalkers he knew AlphaStar favours. The AI still looked very good and the developers claimed that this version of AlphaStar wasn't significantly weaker than the versions which didn't have to use the camera.
- jandrese 8y agoYou aren't kidding about the stalkers. Check out the bar chart at the bottom of the page: https://deepmind.com/blog/alphastar-mastering-real-time-strategy-game-starcraft-ii/#gif-265 https://deepmind.com/blog/alphastar-mastering-real-time-stra... I guess it makes sense that the AI would favor such a micro-heavy unit. I imagine it would be a nightmare to deal with perfect blinking.
- hughzhang 8y agoDealing with perfect blinking is basically impossible, since you can blink back your units right before they die. Stalkers are balanced around the fact that HUMANS have limits to how well they can micro.
- gamegoblin 8y agoI'm also excited to see the future of this bot when they demonstrate a terran AI with near-perfect marine/stim/medivac micro.
- kzrdude 8y agoPerfect micro bots don't excite me much, because they've existed all along, and it's not an AI task.
- WJW 8y agoThere was a "perfect zergling micro vs siege tanks" bot some time ago that would micro lings away from the one that was being fired at by the tanks, thereby negating all the splash damage. The effect was insanely powerful. But as you say, showing that a bot can have perfect micro is not very interesting. Of course a computer can have better control of well defined tasks like moving a unit away just before it dies, especially doing so for many different units concurrently. What is interesting is the wider strategy and how the computer deals with imperfect information.
- samstave 8y ago{{Delivered in the voice of the female British lady who would narrate Beyond 2000 series of shows - or the Modern Marvels narrator, to your mental predilection}} After just decades in development, it is clear that the endeavors of those research scientist have finally bore fruit. And today its in the form of: Intent based modeling, augmented with AI, which provides the reality we see today in both gaming and weapons systems. The user, who must be human, is provided a range of inputs based on the desired outcome of the interaction with the systems and the real world. What results, is truly remarkable. A human is capable of multi-dimensional abstract thought, in a way that a computer cannot. As such - their intent is wired over to a swarm of objects with the most amazing capabilities. A user can direct a swarm of either virtual bots or physical drones to accomplish a task. She can also combine the efforts of both physical and virtual for even greater effect. Here we see a swarm of bots who are thwarted by a physical barrier. The human driver can then instruct his virtual AI bots to attack the security system of the building to allow his drones to have passage. But she does this through merely the intent for the portal to be open. The bots do the rest. All the while the user is updated with real-time information on how the operation is progressing. So, in the future, you may soon see just such technology applied to your kitchen or living room, where bots will cater to your every waking need - and sometimes your non-waking needs as well.
- sleepydog 8y agoI'm curious, would the AI be able to see cloaked units? In sc1 you could see them,( I think sc2 is the same) but it was very difficult. How does the 'raw' interface expose that subtlety?
- ionforce 8y agoThis is actually a great question. Like what does it mean for a unit to be cloaked? If humans can, under ideal circumstances, see cloaked units... Maybe the only mechanic that shows up (like for bots or an API) is the inability to be targeted using an attack command (i.e. you can still be hit with splash damage from ground targeting)
- jon-wood 8y agoMy understanding is that the AI sees things via an API the game exposes, so presumably cloaked units are completely invisible to it until they're revealed.
- yaps8 8y agoNot sure but I think in the video they say the AI does not see cloaked units.
- TulliusCicero 8y agoI'm guessing that while there's a delay for decisionmaking, there's no delay between when it decides to move a camera somewhere else and when it does move the camera (direct API access), whereas humans need to move the mouse or hit a key, which is gonna take at least like 50-100ms where they're not doing anything else. When they were talking about delay they were talking about delay between new information -> deciding/acting, which I think obscures the fact that humans have to do new information -> deciding -> acting, where acting takes non-zero time.