15 ms·
DeepMind’s StarCraft II agent will play anonymously on battle.net
- izzydata 7y agoThat sounds like cheating doesn't it? Can I write a bot to play for me too?
- rasz 7y agoIs it using special API giving it all the information all at once instead of scraping the screen?
- danielhlockard 7y agoThis is in the article. No, it can only deal with things that are visible to it.
- assblaster 7y agoMaybe he was asking if there was any visual perception that had to be done or is the data simply available without having to use visual analysis.
- anchpop 7y agoThe former
- levesque 7y agoIt is not looking at the raw pixels. It gets fed a bunch of arrays, but is limited by what is currently on the screen and not in fog. The idea is that this would be perfectly doable with state of the art machine learning and would not measure our ability at making better AIs, merely add a failure point to the pipeline.
- rasz 7y agoIt still has potential of being hugely unfair when only receiving everything ordinary server broadcasts. As an example in World of Tanks server sends "a tree has fallen" to the client even if said tree is behind 50 other trees, totally in theoretical field of view! = there are cheats letting you know about unseen enemy movement. Then we get to previous blunder, is APM still averaged over last 5 seconds? FAQ carefully omits any numbers, merely promising "more restrictive than demonstration matches". Personally I am not a fan of training our future slave masters how to efficiently kill human targets.
- cjf101 7y agoI don't believe it is using computer vision to read the pixels and translate that into data, no. It will still get the information about what's on its screen from the API. So presumably it will get the same info you or I could get from the minimap (presence of units in a particular area but no details as to what) + detailed information about anything in its camera-like view. This will have some effect on how the bot manages its APM budget, since it now needs to consider camera management. But honestly, from the perspective of the Alpha research, getting information from the pixels probably isn't an interesting problem. They can pretty safely assume that they could build a Computer Vision setup that could get the same info that the API gives, given enough time + GPU horsepower. Any possible inaccuracy/delay that might result from using Computer Vision instead of the API can be simulated. You could add a response delay (already in AlphaStar), or a random chance that the API delivers incorrect information from time to time (which I don't think they do).
- ctrlaltdylan 7y agoMy hope is that they'll eventually open up the API to allow the public to write their own bots.
- plopz 7y agoDo you mean this? https://github.com/Blizzard/s2client-api https://github.com/Blizzard/s2client-api
- deegles 7y agoWhat's the point though? Most people won't have the resources to out-train Google's models. Maybe if every model received the same amount of CPU time to train...
- pawelmurias 7y agoDoing it for fun using traditional methods?
- deegles 7y agoGood point. That was too defeatist of me :)
- crooked-v 7y ago> Can I write a bot to play for me too? Sure, if you can get Blizzard to specifically allow yours in competitive matches for research purposes.
- ryanmercer 7y agoMy first reaction was "I bet this violates the ToS".
- levesque 7y agoIt is opt-in, so if you don't like the idea you don't have to participate. I think that's the best of both worlds.
- damnyou 7y agoIf it's on the official site it doesn't violate the ToS by definition.
- ryanmercer 7y agoYes, for the game creator but if anyone else where to do it it would be "BANNED" which is the point of this comment chain "do as we say not as we do".
- neaden 7y agoThis is just silly. I'm allowed to go into my house whenever I want and you aren't. That isn't me being a hypocrite, people who own things just have more rights to those things.
- damnyou 7y agoI think that can be problematic in some cases (third party browsers on iOS) but video games are not that important.
- ryanmercer 7y agoIt's just amusing a company that sued individuals/companies for selling digital currency for World of Warcraft and has banned accounts from various games for relatively simple bots like mining and fishing in WoW, is going to allow much more 'intelligent' software to play against people.
- melling 7y agoSounds like a great idea. An AI arms race. Lots of smart people...Kids in high school competing could motivate them to learn more math.
- rustyboy 7y agoSure can, just not on open Battle.net https://github.com/deepmind/pysc2 https://github.com/deepmind/pysc2
- Havoc 7y agoThat's so awesome. Not just from a AI perspective but also gaming. Gaming AIs are on a consumer level still pretty rubbish.
- ryandrake 7y agoIndeed. Most “AI difficulty” settings in games involve either crippling the player or giving the computer player extra bonuses/abilities. They are “how much should the computer cheat” sliders. (I’m looking at you, Civilization) It would be great if the norm in game AI was to allow the computer player equal game resources/rules to the human player.
- mikepurvis 7y agoIt's probably gotten harder and harder to dedicate dev resources to building a robust bot player for your game, given that the top tier of players are just going to play online anyway.
- setr 7y agoDepends on the game. Quick-paced, short-lived games like arena fps and rts games naturally develop large enough communities (or die trying) that AI-development can be brushed off in favor of letting the players deal with it. But for games like grand strategies (eg civ), the player population doesn't typically run high enough to support only humans each match (at least partially because the games run too long), and so its more important to develop a decently sane AI.
- opportune 7y agoIt's not only dedicating the time, it's also hiring/maintaining a strong game-AI team able to consistently pump out effective models at the same pace as games are released. You can't just take a regular ol game developer and expect them to make a really competitive game AI without cheating. Even though the work is interesting I doubt you're going to be able to build a full team of reinforcement learning experts for cheap. I would guess that maintaining a 5 person team would cost about $2-3m/year.
- ctrlaltdylan 7y agoThe other quieter announcement is that AlphaStar can play as multiple races. The first public version just showed playing as Protoss. There's some controversy about the AI's field of vision. A person is restricted to using the small mini map for the "whole view" of the playing area. Whereas AlphaStar can view events without a visual restriction. But, if you're into following competitive games the broadcasted match of AlphaStar vs Lambo is pretty incredible to watch. The AI used new and novel strategies that weren't considered before. The AI showed that Stalker can be actually a superior unit to the Immortals if they can be micro'd efficiently.
- Triesault 7y ago> There's some controversy about the AI's field of vision. A person is restricted to using the small mini map for the "whole view" of the playing area. Whereas AlphaStar can view events without a visual restriction. That has changed and AI's 'view' is now restricted. From the FAQ: > Q. How does AlphaStar perceive the game? > A. Like human players, AlphaStar perceives the game using a camera-like view. This means that AlphaStar doesn’t receive information about its opponent unless it is within the camera’s field of view, and it can only move units to locations within its view. All limits on AlphaStar’s performance were designed in consultation with pro players.
- Fnoord 7y agoFeels like RTS games have not fully exploited the potential of multi-monitor setup. Was the AI ahead of the game? Although eyes can only focus on so much (screens would distract, I guess). Bigger monitors also would suffer from peripheral vision effect.
- 83457 7y agoSome RTS games allow for zooming out but many intentionally limit the view as a standard part of the game. Would be interesting to see how much being able to see a huge amount of the map at once would change certain games.
- modeless 7y agoThe most interesting part of this announcement, I think, is the new capabilities and restrictions they disclosed for AlphaStar. It is now playing the latest version of the game, with all three races unrestricted, on multiple maps. It also has much more realistic limits on its capabilities. Restricting the bot to one screen of information at a time is great. There's not much detail on the APM restrictions, but "designed with pro players" is a good sign. Hopefully they've designed some realistic restrictions more complex than just a cap on APM. Of course the anonymous nature of the testing is interesting as well. Big contrast to OpenAI's public play test. I guess it will prevent people from learning to exploit the bot's weaknesses, as they won't know they are playing a bot at all. I hope they eventually do a public test without the anonymity so we can see how its strategies hold up under focused attack.
- vinaybn 7y agoIt'd be even more interesting to see the kind of builds and strategies it would come up with if they capped APM to average or below-average levels.
- woodgrainz 7y agoYes, totally agree. Creative Limitation: https://en.wikipedia.org/wiki/Creative_limitation https://en.wikipedia.org/wiki/Creative_limitation When trying to solve problems, if you add constraints in certain areas, you can sometimes come up with really creative solutions you wouldn't have thought of before.
- drchewbacca 7y agoAPM is an interesting question I think. Like what is the relative importance of APM to strategy? If I have 20% more APM than you do I beat you even if I totally pick the wrong units and build order? Could a super smart bot win against pro's even if it's limited to 20% less APM? So yeah it might be interesting if the bot gets superhuman to trail several versions with progressively lower APM caps to see how much you have to limit it before humans can beat it again.
- 7y ago
- olliej 7y agoI suspect the micro will give it away to higher level players
- MichaelDickens 7y agoI suspect it will play unusual opening build orders, like it did in the show matches last year. That would give it away earlier in the game than its micro. I'm hoping to see AlphaStar come up with some viable build orders that pro humans haven't thought of.
- nitwit005 7y agoIs the screen view limitation much of a limit? You can scan through the map quite quickly using the minimap to quickly move the view.
- levesque 7y agoI guess with number of APM/delay restrictions this would be the same as what a pro player can achieve. And pro player definitely do this, they bounce over the map all the time to monitor what is happening.
- jandrese 7y agoIt would be interesting to see if it clicks on the minimap 20 times per second to keep its state refreshed in addition to issuing orders when viewing the correct screen.
- shawnz 7y agoThey claim that adding the limit barely affected the performance of the bot. So I'm guessing you're right. Requiring it to scan through different screens is not really taking away the inherent advantage of being a computer; it just means a few extra calls.
- MichaelDickens 7y agoAlphaStar is APM-limited, which means it can't just rapid-fire click every location on the map. It has to judiciously pick which places to look in the same way humans do. (At least that's how it worked for the version they showed last year.)
- setr 7y agoI might be remembering the wrong bot, but iirc it was limited only in average APM, and targetting pro-level average APM. So two immediate and obvious flaws were: 1. It could still burst, with overwhelming APM during combat 2. Pro APM is not the same as bot APM, as humans have far more limited precision, and a lot of human APM is wasted on redundant behavior as a result (eg spam clicking to make sure the order goes through) If its still the same, then the bot probably still has lots of excess APM to burn through without impacting micro performance.
- soup10 7y agoHonestly don't get the fascination with AI for Starcraft. Most of the skill when humans plays comes down to who has better micro and macro mechanics. It's not really a "thinking" game like chess or poker.
- pkcsecurity 7y agoWatch some of the games and it might change your opinion. The thesis that "AI in Starcraft will only win via improved mechanics" is false - the AI was making some fascinating decisions / fundamentally different meta strategies.
- MichaelDickens 7y agoOr watch [this game](https://www.youtube.com/watch?v=vUfwb4nOL84 https://www.youtube.com/watch?v=vUfwb4nOL84) between the top StarCraft AI (outside of AlphaStar) versus Serral, one of the top humans players. Unlike AlphaStar, this AI is not APM-limited; IIRC the top bots tend to play with about 100,000 APM, compared to 400 for the top humans. Serral won easily, despite the AI's vastly better mechanical skill.
- loser777 7y agoStarCraft or any RTS presents new challenges that were not covered by previous games. Basic things such as the massive action space meant that the previous “tabula rasa” approach was abandoned in favor of imitation learning to get the agents off the ground. Micro and macro are meaningless if you cannot put a build or semi-cohesive game plan together; a skill we take for granted among human players. That’s where I think the real interesting parts come about: crafting build orders, reactions to other builds, and new tactics that may emerge. You can tell that this is what the researchers are trying to achieve by limiting the throughput in terms of actions per minute.
- opportune 7y agoFiguring out good timings, gathering intel, harrassing, doing big drops, when to invest in attacking with a gimmicky unit, etc. are all pretty big strategic decisions. A lot of people don't notice these decisions being made when they watch pro players play since they are the composition of many actions that, yes, at the end of the day are building units and moving them around. But that's like saying chess is all just moving pieces around too
- dsjoerg 7y agoAPM is effectively bandwidth, but just as important if not more important is latency -- which is called TTFA, Time-To-First-Action. See https://illiteracyhasdownsides.com/2016/12/23/time-to-first-action-and-comparative-player-analysis/ https://illiteracyhasdownsides.com/2016/12/23/time-to-first-... and the Skillcraft.ca study. If they're not limiting AlphaStar's TTFA, then it can respond instantly to problems all over the battlefield, which is superhuman in an uninteresting way.
- philipkglass 7y agoIn any real-world application (robotic manufacturing, self driving vehicles, precision guided munitions targeting...) extremely fast reaction times are an essential and expected advantage of machines. I see AI game playing as interesting mostly because it provides a way to pit software against people without building a bunch of expensive physical infrastructure. If anyone ever builds a "real" robotic army it will surely use all the APM and TTFA advantages it can possibly achieve. In that sense, allowing the same advantages in combat simulation games is closer to a proper man-machine contest than one where those advantages are taken away from the machine.
- scarejunba 7y agoI guess the thing people are interested in is a program that can autonomously play the intelligent parts of the game - the strategy and all that. I assume Starcraft is a poor choice for that, though, because of the massive importance of micro. For instance, imagine you’re playing a chess game with a 100 ms timer and first to exhaust their timer loses. No human will win and I could create a program that could best Kasparov trivially by advancing each pawn. There’s the game and then the input layer problem. Maybe Civilization IV ;)
- z3phyr 7y agoThere is a build time limit as well as a resource limit. Its not exactly a simple race
- quakenul 7y ago
- kregasaurusrex 7y agoHaving watched the livestream from January[0], the AlphaStar agent was able to create its own individual agents to play against and then learn from in the same way AlphaZero learned from chess & baduk/go historic games. In AlphaStar's case this learning period was described as experiencing the equivalent of hundreds of years of aggregate gameplay. This allows an agent to adjust to novel strategies not seen before because Starcraft II's number of possible game states exponentially increases as the game progresses; compared with chess and go that have large albeit fixed board states. There's also a competition for individuals who build their own AI engines[1] for Starcraft II much like how Stockfish and LeelaZero compete against one another in their own respective AI chess leagues. [0] https://www.youtube.com/watch?v=cUTMhmVh1qs https://www.youtube.com/watch?v=cUTMhmVh1qs [1] http://wiki.sc2ai.net/Main_Page http://wiki.sc2ai.net/Main_Page
- Nimitz14 7y agoWith its very weird playstyle not knowing one is playing against it will be very annoying. Oh well, still curious to see how it will do.
- grumpy8 7y agoWill it start in bronze and then just crush everyone until it's rank #1?
- deleted 7y ago[deleted]
- gcoda 7y agoEffective APM limits is not enough. No human can maximize target firing before each shot like AlphaStar did. Not a lot of people even talked about it
- hannasanarion 7y agoFor the demo they were limiting average APM not EAPM. That's how it was able to get such superhuman battle micro: by playing slower than usual before and after so that the average was below the limit.
- defertoreptar 7y agoSounds like they're addressing this concern: > These caps, including the agents’ peak APM, are more restrictive than DeepMind’s demonstration matches back in January, and have been applied in consultation with pro players.
- bduerst 7y agoAlphastar's APM wasn't even abused that much either back in January: https://deepmind.com/blog/alphastar-mastering-real-time-strategy-game-starcraft-ii/#image-15401 https://deepmind.com/blog/alphastar-mastering-real-time-stra...
- JyB 7y agoIt was. It's APM burst of picture perfect micro in tense fights were insane. Human player holding down a key that produces thousands APM certainly skewed this misleading chart.
- hartator 7y agoDoes anyone know if DeepMind is fed raw images of the screen to process via ML or it's already a parsed data of the game state?
- marviel 7y agoFrom the article: >Q. How does AlphaStar perceive the game? >A. Like human players, AlphaStar perceives the game using a camera-like view. This means that AlphaStar doesn’t receive information about its opponent unless it is within the camera’s field of view, and it can only move units to locations within its view. All limits on AlphaStar’s performance were designed in consultation with pro players.
- hartator 7y agoI don't think that answers the question. As it can just mean the AI has to move a camera-like view (sic) but still doesn't have to use computer vision to get which unit is which, health bars, and things in the like.
- marviel 7y agoFair point, I suppose I didn't read as carefully as I should've. Thanks!
- DiogenesKynikos 7y agoI'm fairly certain that AlphaStar does not work off of the individual pixels. It gets a more abstract representation of the game state. At least, that's how the original AlphaStar worked.
- evv 7y agoIt is a particularly interesting question in StarCraft because of the cloaked units, which are visible only by distorting the background (and from their sound). Most humans will be able to identify cloaked units, but only if they look carefully, and not in heavy battle. Can the AIs see and/or identify cloaked units? It begs the question if fair gameplay is even possible unless the AI uses machine vision against the same interface. For fair human-vs-AI games, they shouldn't allow cloaked units!
- cronix 7y agoGreetings, Professor Falken. Would you like to play a game?
- solstice 7y agoI agree. do we want to teach AIs war? This seems like a decision/trend that humanity might regret profoundly in a century or two...
- mikenew 7y agoIf AlphaStar is playing at the top of the ladder it probably won't be too hard to figure out that it's AlphaStar. There's only around 15 or so players with MMR above 6000, and they tend to know who they've been matched up against, even if the opponent hides their name with a barcode (they name themselves "IIIIIIIIIIII" so you can't recognize who it is. And AlphaStar has a pretty distinct play style too. Unless it's playing more towards the middle of the ladder where there's lots of players I don't think the test would be very anonymous. Regardless, I'm pretty excited to see what happens. Hoping to luck into a game.
- loser777 7y agoYes, this is why I hope there is an account associated with it that can be tracked by the usual sites (rankedftw, sc2unmasked) etc.
- nickpsecurity 7y agoShould be easy to spot based on the demo. Look for the one with way more gatherers than anyone uses, a bunch of disruptors getting amazing micro shots, and groups attacking up ramps in ways human players usually don't.
- herogreen 7y agoI am sure they will find a way to dampen its strength while improving it at the same time. Some ideas: reducing number of neurons, reducing neural network running frequency.
- opportune 7y agoIf they are using monte carlo tree search or some other minimax algorithm the standard way to do this is to limit the depth of the search tree. But not sure how they would use MCTS for starcraft. Could be they are using unsupervised learning to figure out how to represent the search nodes
- jammygit 7y agoMaybe it will stream eventually
- zwaps 7y agoLooking forward to AlphaStar learning to spam bad manner chat commands to unnerv the other player
- yters 7y agoI'm very interested in what sort of adversarial gameplay can be used against these sorts of AIs. I've read that the chess versions all have weak points, where if you know you are playing an AI, you can easily exploit them and win. They usually seem to deal with strategies over many moves, since the AI look ahead approach cannot go very many plies deep. I suspect that once a human can break a micro spamming AI tactic he can consistently beat an AI with a more long range strategy. And perhaps this approach is in general undefeatable by an AI, since it seems that AI play can only either be short term spam attacks or long play look up tables. The search space for short term play is tractable, but long term play is exponential, so AI brute forcing will lose out to human principled reasoning. Thus, without human input in the form of game tables, the alphazero variant AIs can only optimize for short term spamming. And the alphago/deep blue variants are always downstream from human play, since they depend on human gameplay tables for deriving long term strategy and insight.
- deleted 7y ago[deleted]
- philipkglass 7y ago> I've read that the chess versions all have weak points, where if you know you are playing an AI, you can easily exploit them and win. That may have been true in the past but it hasn't been so for more than a decade. A laptop running Stockfish handily beats top human players, even if the players know a year in advance the exact hardware and software revision they will be playing against. https://en.wikipedia.org/wiki/Human%E2%80%93computer_chess_matches#Kramnik%E2%80%93Deep_Fritz_(2006) https://en.wikipedia.org/wiki/Human%E2%80%93computer_chess_m... Kramnik, then still the World Champion, played a six-game match against the computer program Deep Fritz in Bonn, Germany from November 25 to December 5, 2006, losing 4–2 to the machine, with two losses and four draws. ... There was speculation that interest in human–computer chess competition would plummet as a result of the 2006 Kramnik–Deep Fritz match. According to McGill University computer science professor Monty Newborn, for example, "I don’t know what one could get out of it [a further match] at this point. The science is done.". The prediction appears to have come true, with no further major human–computer matches, as of 2019.
- z3phyr 7y agoStarcraft BroodWar is very easily accessible for writing bots. Check out https://bwapi.github.io https://bwapi.github.io I encourage all the fellow SC players to experiment with it. (SC2 is a huge download, and thus I never moved to try it)
- dgant 7y agoThe Brood War AI development community is very welcoming and supportive. You can see bots in action at https://twitch.tv/sscait https://twitch.tv/sscait Most discussion happen on Discord at https://discord.gg/QU457H https://discord.gg/QU457H
- deleted 7y ago[deleted]
- Waterluvian 7y agoWebsite won't load for me. Sorry if it's already explained. Does this implicitly mean it's okay if I make bots and let them play on battle net?
- JakeTheAndroid 7y agoIt does not appear so, this seems to be a dedicate partnership not something open to the public.
- JyB 7y agoThe AI they so proudly showcased last year learned to beat the limitations put in place. It was really funny. The DeepMind team put a cap on the average APM it could perform over some period of time. Being a micro intensive game, having a perfect micro even for a short time is a game changer. The AI just learned that by dropping it's APM low it would be allowed to have insane and inhuman bursts during critical fights and still be within the "rules" made up by the DeepMind team. It turned out it was one of the most successful way to win games.
- ehsankia 7y agoI feel like this really undersells what they showed though. Sure, APM was an issue, but all the different and varied strategies in managed to come up with was still really impressive. It seems like they have since focused more on the "single screen" model, with more restrictive APM limits (hopefully also limiting short peaks). I'm really curious to see how far they've come. I'm assuming the big showcase will be during Blizzcon.
- tareqak 7y agoExactly, you can't simply cap peak APM, you need to cap the maximum APM too.
- pjspycha 7y agoIt was also really unimpressive in my opinion, instead of being smarter and making broad decisions about tactics that are harnessed by some perfect unit composition knowledge, the AI won on a purely micro scale. There are videos from several microbots such as Automaton 2000: https://www.youtube.com/watch?v=IKVFZ28ybQs https://www.youtube.com/watch?v=IKVFZ28ybQs that showcase what super APM can do. The DeepMind AI that beat some pro players did it by having better micro while generally having worse strategies. The DeepMind matches showed how better micro can turn a generally weaker unit composition into the winning unit composition just as that Automaton 2000 video did. To me it seemed that the DeepMind team figured out that the only way to beat competent players was to do what all those microbots do and pump APM into godly levels. They decided to limit APM, however like you said, just average APM and have the bots explode APM when needed. The real funny match was when MaNa beat Deepmind by completely breaking the AI with generally simple drop strategies and made Deepmind look very much inept.
- gmueckl 7y agoReal time strategy games are peculiar because they are played mostly moment to moment in a very reactive style with very little medium or long term planning (beyond the next batch of units in production). So a neural network with a tiny bit of memory should be able to play that by essentially learning counters and a few harrassment and attack tricks. Sure, there's a bit more involved, but when you look at it, any RTS strategy decomposes into a lot of short term behaviours that are sequenced based on momentary triggers. A more interesting challenge in my mind is a game that focusses genuinely on longer term planning, where actions taken at a certain time lead to results 10 to 15 minutes later in game that is simulated in a continuous fashion (that is, definitely not turn based and with no way to discretize it perfectly into turns). The loss of a turn structure makes applying min-max-search based strategies hard to apply - each side can make any number of moves in sequence. Add non-discrete moves (e.g. turn unit with a certain turn rate for an arbitrary amount of time, then move forward for another arbitrary amount of time) and the search space becomes vast and unstructured, potentially even unbounded. Solutions to that should be very interesting.
- philipov 7y ago> Real time strategy games are peculiar because they are played mostly moment to moment in a very reactive style with very little medium or long term planning (beyond the next batch of units in production). This is simply not true at a high level of play. Timing attacks, base expansions, and tech transitions involve both medium and long-term planning.
- gmueckl 7y agoBase expansions and tech transitions as actions are all triggered by certain momentary events. This is simply due to the fact that each of necessary actions for that have prerequisites. And a neural network will simply learn long term strategies as sequences of trigger responses without any actual long term memory involved.
- philipov 7y agoif you're not thinking several moves ahead with your tech transitions, you're going to have a bad time.
- ggggtez 7y agoVery curious how this is going to turn out... This sounds like they are trying to train a bot to actually not be perfect? Otherwise I think they would say straight out: "You'll only have the option if you are grand-master". Since they don't say that, it feels like they are probably training the bot to "play like it's at Gold League" etc. If it could make the same types of mistakes and overlook things in the same way a human would, that would be very interesting for game creators. Most game creators would tell you: usually the hard thing is not making a good AI, but making an AI that is fun, but still loses. We've all seen that AI can usually just win any game, if you give it enough juice.
- nicwilson 7y ago> This sounds like they are trying to train a bot to actually not be perfect? (At least part of) The training has MMR as a label from unsupervised learning from human games so as part of the configuration they can set the agent to play like someone with a set MMR. Lex Fridman's interview with Oriol Vinyalis on Lex's AI podcast covers this in more depth.
- deleted 7y ago[deleted]
- jammygit 7y agoI had no idea there were so many Starcraft players on hn. This thread reminds me of team liquid :)
- Taniwha 7y agoThey'll have to up its trash-talking game
- jammygit 7y agoJust tried the mobile twitch app to check this out. Apparently you can’t watch without logging in now. Amazon much want to know what we’re watching and saying as a requirement of service
- Iv 7y agoMeanwhile, a pro-player hides his/her identity on the Korean ladder under the name "AlphaStar" and was the top 10 a few months ago.
- tomrod 7y agoIf there is a SC3, a logic rule/AI element to the competition would be super cool.
- ralusek 7y agoThe most disappointing part of AlphaStar to me was the fact that each game was played by a completely separate AI. I was sad to see that each intelligence seemed to only be able to converge on a single strategy/unit composition. It was a failure to settle on a more generalized intelligence, as well as an indication that many of its victories in reinforcement were potentially achieved as a result of having composed units as hard counters to other compositions.
- s1artibartfast 7y agoRegarding your disappointment, human player goes into a game with an intended strategy, how different is this different than selecting a strategy based AI for each game? I would like to rewatch the replays with this in mind, but the AI did appear to transition between different unit compositions and strategies at different points in the game. I wonder the degree to which this was predetermined opposed to reactive.
- pinouchon 7y agoIt was pretty pre-detemined (at least in the matches vs Mana. The best pros can react very fast to unusual strategies (cheese), or change their strategy if the situation calls for it (eg: terran all-ins). I agree with the sentiment of disappointment of having to make a "league" with specialised AIs. It seems to be lacking a high level reasoning and executive module, and the league acts as a crutch. The league idea still super impressive and clever, but human players do not go around in gangs where only one of them takes a seat for each match.
- gigatexal 7y agoComment deleted cuz I’m too busy to read details of articles.
- dEnigma 7y agoIt is opt-in, as it says right in the second paragraph and then again further down the page: If you would like the chance to help DeepMind with its research by matching against AlphaStar, you can opt in by clicking the “opt-in” button on the in-game popup window.
- gigatexal 7y agoI should have skimmed the article better. Thanks.
- cf498 7y agoI wonder in which way an ethics board was consulted for this. Is it ethically justifiable to introduce an anonymously "cheating" AI like DeepMind in the competitive ladder? After all > A win or a loss against AlphaStar will affect your MMR as normal. While the scenario at hand might be relatively unproblematic, at what point does an ethics board get consulted for anonymous trials concerning AI - human interaction? Is this something on the radar of the DeepMind team?
- leggomylibro 7y agoAlso, is it legal in California? https://leginfo.legislature.ca.gov/faces/billTextClient.xhtml?bill_id=201720180SB1001 https://leginfo.legislature.ca.gov/faces/billTextClient.xhtm... I'm not a lawyer, but it sounds like they're probably okay as long as the bot doesn't advertise anything or incite people to vote.
- cf498 7y agoI missed the part of the article which mentions getting matched against deepMind is opt-in in the first go through. So everything should be fine.
- baddox 7y agoIt’s opt-in, and also it doesn’t even come close to matching the descriptions in the bill. > for the purpose of knowingly deceiving the person about the content of the communication in order to incentivize a purchase or sale of goods or services in a commercial transaction or to influence a vote in an election.
- dsl 7y agoMaybe that is why it is only being done on the European ladder. Deepmind is a European company owned by Alphabet.
- baddox 7y agoEach player has to opt-in to the possibility of being matched with the anonymous AI player.
- hellenwaweru 7y agosometimes alpphastar can be dissapointing as each game is played by a separate AI https://finance.uonbi.ac.ke/node/54172 https://finance.uonbi.ac.ke/node/54172
- beders 7y agoI'm a gold league noob getting beaten by the run-of-the-mill smurf with a new account. I couldn't tell if it is DeepMind or not ;)
- ionwake 7y agoDoes anyone know if it is possible to run Alphastar locally?
- gourou 7y agoI guess they're learning for OpenAI's mistakes on Dota2 (people were exchanging strategies online) https://www.reddit.com/r/DotA2/comments/6t8qvs/openai_bots_were_defeated_atleast_50_times/ https://www.reddit.com/r/DotA2/comments/6t8qvs/openai_bots_w...
- jakegold 7y agoIn January 2019, DeepMind introduced AlphaStar, a program playing the real-time strategy game StarCraft II. AlphaStar uses a reinforced learning to learn the basics of the Protoss race based on replays from human players, and later played against itself to enhance its skills. At the time of the presentation, AlphaStar had knowledge equivalent to 200 years of playing time; it won 10 consecutive matches against professional players, and lost just one.
- jakegold 7y agoHumans tend to think we’re adept at the games we create, but computers have proven time and time again that we’re just not fast enough to stay on top. Machines have defeated us in chess, Jeopardy!, and even the deviously complex board game Go. Google-owned DeepMind gets credit for that last one, and now it’s dominating another game: StarCraft II. After just 18 months, DeepMind has an AI that beats the world’s best StarCraft II players, and it’s not even close. DeepMind called its Go-dominating AI “AlphaGo,” and the StarCraft-playing bot got a similar moniker. It’s called AlphaStar, and it has more than 200 years of practice under its belt. Back at Blizzcon in November, DeepMind said its machine learning platform had managed to beat the “Insane” difficulty in-game AI about half the time. Well, it’s gotten much better since then. AlphaStar is a convolutional neural network. The team started with replays of pro matches, giving AlphaStar a starting point to begin playing the game. Through intensive training with competing models, DeepMind was able to teach AlphaStar how to play the game as well as the best human players. Over time, it whittled the AI down to the five best “agents,” and that’s what it deployed against some of the most skilled StarCraft II players in the world. The matches actually took place in December, so today’s internet broadcast mostly featured replays of those matches. First, AlphaStar battled a player known as TLO, who primarily plays Zerg in StarCraft. However, he had to play Protoss as that’s the only race AlphaStar trains with right now. This competition wasn’t even close — despite TLO’s best efforts, AlphaStar beat him five games to zero. Next, a different AlphaStar agent went up against a seasoned Protoss player called MaNa. Some of these matches were closer, but AlphaStar still won five games to zero. MaNa also competed against a new AlphaStar agent live on the stream, and this time MaNa finally pulled out a win. AlphaStar demonstrated impressive micromanagement of units throughout the matches. It was quick to move damaged units back, cycling stronger ones into the front line of battles. AlphaStar also controlled the pace of battle by bringing units forward and dropping back at just the right times to inflict damage while taking less fire itself. This isn’t just a function of brute force actions per minute (APM) — AlphaStar has substantially lower APM compared with the human players, but it’s making smarter choices. The AI also had some interesting strategic quirks. It often rushed units up ramps, which is dangerous in StarCraft II as you can’t see what’s up there until you move in. Still, it somehow worked. AlphaStar also eschewed the tried-and-true tactic of blocking off the base ramp with a wall of buildings. That’s StarCraft 101, but the AI didn’t bother with it and still managed to defend its bases. It wasn’t until the final live match that the human challenger spotted a flaw in one of the agents. That version of AlphaStar committed to moving almost its entire army as one with the intention of swarming MaNa’s base. However, MaNa was able to repeatedly warp in a few units at the back of AlphaStar’s base. Each time, AlphaStar would turn its army around to deal with the threat. That gave MaNa enough time to build up a more powerful force and take the fight to the AI. At the end of the day, AlphaStar won 10 matches against pro players and lost just one. If AlphaStar learned from that last match, it might be unbeatable next time.