7 ms·
simply put because AI is way too stupid for that kind of stuff. When we talk about AI today most of what we talk about is actually just processing sensory input
by Barrin92 6y ago
simply put because AI is way too stupid for that kind of stuff. When we talk about AI today most of what we talk about is actually just processing sensory input at a low level.
Wargames and strategy require cognition and level of contextual awareness and understanding of human motivation and intent that falls well into the realm of sci-fi AGI. No military confrontation is generic enough to run on some ML pattern-matching or travelling salesman type algorithm.
I mean just to talk about how low-level and limited AI is, when you take any modern learning system, you teach it Atari Breakout, if you adjust the panel by a bunch of pixels or rotate the screen you need to relearn or transfer-learn the game because the algorithm doesn't even understand the ontology of the game and really just manipulates pixels.
Even Deepmind's starcaft bot was stupid in this sense. It didn't understand starcraft strategy at all (which was visible in it's nonsensical unit combinations it was building) but simply out-microed its opponent, it just had better mechanics.
- dwohnitmok 6y ago> Even Deepmind's starcaft bot was stupid in this sense. It didn't understand starcraft strategy at all (which was visible in it's nonsensical unit combinations it was building) but simply out-microed its opponent, it just had better mechanics. Protoss Alphastar was fantastic. It was definitely not just out-microing opponents (after later refinements Alphastar's micro limitations were very human-like), but really had an understanding of build orders, positioning, choke points and the like. Here's a great game it played against Serral (one of if not the top Zerg player in the world) where it holds fantastically against Serral's aggression and is able to use the layout of its own base to pick apart what looked like a winning position for Serral: https://www.youtube.com/watch?v=C6qmPNyKRGw https://www.youtube.com/watch?v=C6qmPNyKRGw
- tornato7 6y agoAs an avid StarCraft player I still think AlphaStar is one of the most impressive AI programs ever made. While it didn't get everything quite right, it exhibited planning and creativity in it's builds, and didn't just do the same exact thing every time; it scouted and reacted to the opponent's moves with professional-level proficiency.
- CyanBird 6y agoIt didn't react it had pre-planned build orders That's something which was mentioned when it came to deep mind team talking of all the "different agents" they had trained
- dwohnitmok 6y agoAs far as I understand it did actually react. AlphaStar's training process consisted of two phases: an imitation-of-human-players learning phase that created a base set of "templates" and then self-play among agents seeded from those templates. When creating those templates, they basically ended up with "baked-in" build orders. But self-play among agents ended up creating a variety of reactive strategies on top of those build orders, so that agents would modify them on-the-fly as the game situation changed. At a high level this is basically how humans use build orders as well.
- Retric 6y agoLater refinements where still quite superhuman, just in terms of consistency not abusing stalker micro. For example it doesn’t need control groups, that’s a clear sign it’s not sticking close to human limitations.
- onethought 6y agoYeah the alpha star team didn’t really emphasise it. It’s APMs were human like in count, but they had basically 0 wasted actions, they were all meaningful. Lots of APM are used by repeat keys or mass clicking.
- dwohnitmok 6y ago> Lots of APM are used by repeat keys or mass clicking. Both of those (and more) are filtered by EAPM measures (effective APM) and even on those metrics Alphastar still had a lower EAPM count than most pros.
- Retric 6y agoEAPM still includes a lot of pointless clicking by pros. Just look at periods of the game when there is nothing productive to do. By comparison a throttled Aplphastar has no need for any pointless actions and can get timings inhumanly precise which games EAPM in the other direction.
- dwohnitmok 6y agoKind of. The only reason it didn't use control groups is because it had "soft" control groups of its own (IIRC there were limits on how granular of actions it could take as well as how many distinct move commands it could issue). I mean looking at that Serral game I don't see any superhuman micro on the part of Alphastar. Just fantastic exploitation of base layout and steadily pressing every strategic weakness Serral made in his attack. If anything on the consistency front, Alphastar's main advantages came from superhuman macro (effectively never forgetting about making sure workers are busy), but the edge there vs human pros is pretty slight.
- nindalf 6y agoI don’t think it’s correct to characterise these bots as one trick ponies, winning based on micro. Take the Dota 2 AI built by OpenAI. Dota 2 isn’t micro intense, it’s mostly about strategy. These bots are capable of beating the best human teams. Their strategy is interesting because it’s different from how humans have played this game as long as it has existed. For example, in a 5v5 humans will skew resources towards so 2-3 players (“cores”) have more to work with than the 2 “supports”. This has always been taken for granted. But OpenAI distributed them evenly, allowing for some interesting strategies. It’s still not perfect. It still can’t play the full game with no restrictions. But it is discovering new strategies that humans never did. It’s not just micro.
- boomboomsubban 6y agoHave humans adapted their strategy with similar success? As I would guess those strategies rely on the improved micro in movement, hp vs damage possible analysis, and communication.
- nerdponx 6y agoThe Shadow Fiend AI was consistently beating pros in 1v1 because it had flawless technical execution of the standard gameplay on that hero, eventually forcing errors out of the fallible and emotional human players. It wasn't anything new, it was just perfect.
- hntrader 6y agoThey've moved beyond that now. Shadow Fiend won mostly due to superior micro but their newer 5v5 bot has human-level "planning" and executive function.
- nindalf 6y agoSort of, but I can't be sure that this attributed entirely to OpenAI or other changes. It used to be more common 5-6 years ago to devote all available resources to one player ("carry") and the other 4 make space for the carry. In the last few years it's become more common to have 3 cores who get sufficient resources. It also sometimes happens that the 4th player has resources equal to the top 3. But always, the 5th player is dirt poor. FWIW the developer of the game has also tried to fix this over the years, devising ways to get more resources to the 4th and 5th players. For example, there is a system similar to UBI where all members of the team benefit equally from "bounty runes". But till date, the bots have achieved a level of egalitarianism yet to be matched by human players.
- blackbear_ 6y ago> Simply put because AI is way too stupid for that kind of stuff. When we talk about AI today most of what we talk about is actually just processing sensory input at a low level. This is a very narrow view of AI. In fact, the limitations you are talking about apply only to deep learning (which is frequently and mistakenly confused for AI nowadays). Other well-studied branches of artificial intelligence include planning [1] and reasoning [2]. By far the biggest problem is to formalize the real world and build a realistic simulation which the AI system can play with. After that, a decent system would blow most humans out of the water. > Even Deepmind's starcaft bot was stupid in this sense. It didn't understand starcraft strategy at all (which was visible in it's nonsensical unit combinations it was building) but simply out-microed its opponent, it just had better mechanics. Maybe, what about go and chess? The feeling there was that humans did not understand the game very well. [1] https://en.wikipedia.org/wiki/Automated_planning_and_scheduling https://en.wikipedia.org/wiki/Automated_planning_and_schedul... [2] https://en.wikipedia.org/wiki/Automated_reasoning https://en.wikipedia.org/wiki/Automated_reasoning
- pbronez 6y ago> limitations you are talking about apply only to deep learning (which is frequently and mistakenly confused for AI nowadays) Deep learning is also where all the money and attention is going, and where the revolutionary gains have been seen in the last few years. They’re pretty good at compressing huge datasets into a queriable structure and generating features for hierarchical data, but are just one component of a generalized system that could handle something like war. > By far the biggest problem is to formalize the real world and build a realistic simulation which the AI system can play with Strong agree! The fundamental challenge is to create digital model of the world with enough detail & accuracy that you can run optimizations on it and trust the results. This is as true for robotic aircraft as it is for autonomous cars or an e-commerce data warehouse. People need to decide what subset of the world to observe, deploy & maintain sensors to collect those observations, build information systems to organize & serve the observations, and maintain the whole thing. Then maybe you can start running AI/ML on it.
- IG_Semmelweiss 6y agoActually, it is famously said that what made napoleon a fabulous field marshall was his extensive reading and learning of historical battles. This gave him an extraordinary ability to contrast live battle situations with a huge library of learned historical situations, helping him to make decisions on battle plans.
- Breza 6y agoYou're exactly correct about war games. Warfare is more than just moving units around a battlefield. It involves psyops, cyber, logistics, and other factors that are way too complex for contemporary AI to consider.