4 ms·
During the thread from the competition there were a few comments suggesting that the neural network could easily be run on a personal computer. Given the massi
by minimaxir 8y ago
During the thread from the competition there were a few comments suggesting that the neural network could easily be run on a personal computer.
Given the massive network architecture linked in the post (https://s3-us-west-2.amazonaws.com/openai-assets/dota_benchmark_results/network_diagram_08_06_2018.pdf https://s3-us-west-2.amazonaws.com/openai-assets/dota_benchm...), I am rather curious what hardware was used to make predictions for the Benchmark match. Especially due to the 2048 unit LSTM.
The model outputs are also interesting; they're all discrete actions (even movements), no continuous outputs (aside from win probability).
- bllguo 8y agonot sure I follow; what's so interesting there? Wouldn't a continuous output ultimately have to be translated into a discrete action anyway?
- minimaxir 8y agoThe big ones are the X and Y offsets/moves; you'd expect it the output to be an explicit coordinate to move to/act upon (e.g. a specific value in the -400 to 400 space), but per the original announcement (https://blog.openai.com/openai-five/ https://blog.openai.com/openai-five/), there's a 9v9 grid space. (-400 to 400 by increments of 100 each axis) Although making discrete choices 2-3 times a second is indistinguishable from continuous movement anyways.
- sgillen 8y agoI think it just comes down to the fact that discrete action spaces are easier to work with for most RL frameworks (not sure what exactly open AI is using here though).