5 ms·

hi,does anyone know if openAI release an up to date state of learning for their open AI dota code? Basically can I run the same sim on my laptop and watch them

hi,does anyone know if openAI release an up to date state of learning for their open AI dota code? Basically can I run the same sim on my laptop and watch them play? I can see some code on Github but dont know if the actually neural net data is available too. If anyone knows the answer that will be great thanks

eerikkivistik 8y ago
Last time I looked, I did not find any published trained nets on it. As far as I know, the custom build of Dota they use isn't public either. It will most likely change in the near future though, would be the next logical step for the OpenAI team as per the goal of their organization.
minimaxir 8y ago
Even if they did release the likely-very-big model, your personal computer is likely not fast enough to make 2-3 actions per second (x5) and update weights in real time without a beefy GPU.
- eerikkivistik 8y ago
  I think the model itself could probably run on a PC with 64gb of RAM/VRAM (Well okay, it would be an unorthodox personal computer, I guess my point is, you could probably fit it in a Single computer, not one you have at home though). Training it definitely not possible without a large cluster.
- ionwake 8y ago
  Thank you for the reply minimaxir - are you sure a 2015 macbook pro cannot run a compiled version of the neural net so it can play itself on my computer? Just wanted to double check - can someone else verify this before I spend weeks seeing if I can get it to work?
  - deleted 8y ago
    [deleted]
  - rhaps0dy 8y ago
    I'm pretty sure that a macbook pro could run the 5 agents using minimal GPU acceleration (eg WebGL) A 1024 unit LSTM only takes up a few megabytes of memory, and the multiplications at runtime are O(N^2) and not O(N^2 M), because you don't have a minibatch of updates to run.
- drexlspivey 8y ago
  You don't need to update any weights, the model is already trained.
  - minimaxir 8y ago
    My initial read of https://blog.openai.com/openai-five/ https://blog.openai.com/openai-five/ was that the 1024-cell LSTM game state layer was trained on the fly, but after rereading it may not be the case.
  - lma21 8y ago
    Ignorant here. How do you take an already trained model and execute it elsewhere? Isn’t the training phase part of the whole (ongoing) simulation?
    - sethgecko 8y ago
      The training phase is when you are trying to minimise your loss function by trying different weights each iteration. Once that is finished, you have a trained model which you can use by providing input and getting an output (with the weights frozen). The training phase is very expensive computationally because you have to calculate the gradient of your loss function on potentially huge tensors. The execution phase is not that expensive and commercial laptops will be likely able to run the model without any problems.

eerikkivistik 8y ago

Last time I looked, I did not find any published trained nets on it. As far as I know, the custom build of Dota they use isn't public either. It will most likely change in the near future though, would be the next logical step for the OpenAI team as per the goal of their organization.

minimaxir 8y ago

Even if they did release the likely-very-big model, your personal computer is likely not fast enough to make 2-3 actions per second (x5) and update weights in real time without a beefy GPU.

eerikkivistik 8y ago
I think the model itself could probably run on a PC with 64gb of RAM/VRAM (Well okay, it would be an unorthodox personal computer, I guess my point is, you could probably fit it in a Single computer, not one you have at home though). Training it definitely not possible without a large cluster.
ionwake 8y ago
Thank you for the reply minimaxir - are you sure a 2015 macbook pro cannot run a compiled version of the neural net so it can play itself on my computer? Just wanted to double check - can someone else verify this before I spend weeks seeing if I can get it to work?
- deleted 8y ago
  [deleted]
- rhaps0dy 8y ago
  I'm pretty sure that a macbook pro could run the 5 agents using minimal GPU acceleration (eg WebGL) A 1024 unit LSTM only takes up a few megabytes of memory, and the multiplications at runtime are O(N^2) and not O(N^2 M), because you don't have a minibatch of updates to run.
drexlspivey 8y ago
You don't need to update any weights, the model is already trained.
- minimaxir 8y ago
  My initial read of https://blog.openai.com/openai-five/ https://blog.openai.com/openai-five/ was that the 1024-cell LSTM game state layer was trained on the fly, but after rereading it may not be the case.
- lma21 8y ago
  Ignorant here. How do you take an already trained model and execute it elsewhere? Isn’t the training phase part of the whole (ongoing) simulation?
  - sethgecko 8y ago
    The training phase is when you are trying to minimise your loss function by trying different weights each iteration. Once that is finished, you have a trained model which you can use by providing input and getting an output (with the weights frozen). The training phase is very expensive computationally because you have to calculate the gradient of your loss function on potentially huge tensors. The execution phase is not that expensive and commercial laptops will be likely able to run the model without any problems.