19 ms·
You don't know what you are talking about, your whole premise is that everything is simulated therefore all it does is searching, so I will refute that and not
by PartiallyTyped 6y ago
You don't know what you are talking about, your whole premise is that everything is simulated therefore all it does is searching, so I will refute that and not bother with the rest of the comment because it is not worth it and you are not talking in good faith, instead you assume and support your assumption.
> No, the bots playing complicated games like starcraft weren't ML but human coded behaviour that used ML based position evaluation to handle movement. Position evaluation is just image recognition, so I don't see those bots as doing anything novel ML wise, same with chess and GO.
From the alpha star article
> Although there have been significant successes in video games such as Atari, Mario, Quake III Arena Capture the Flag, and Dota 2, until now, AI techniques have struggled to cope with the complexity of StarCraft. The best results were made possible by hand-crafting major elements of the system, imposing significant restrictions on the game rules, giving systems superhuman capabilities, or by playing on simplified maps. Even with these modifications, no system has come anywhere close to rivalling the skill of professional players. In contrast, AlphaStar plays the full game of StarCraft II, using a deep neural network that is trained directly from raw game data by supervised learning and reinforcement learning.
> Why isn't this interesting for real world applications? Because games can be simulated perfectly, the real world can't. The bots relied on simulating the entire game from start to finish in every frame, that method can only ever work in a game where human coders can write down exactly what happens for every single scenario. Training was also dependant on being able to simulate the world perfectly.
Dota-Five is literally a reinforcement learning algorithm, PPO, on steroids, without simulating what will happen but just playing the game, same for AlphaStar and Atari/Agent57.