4 ms·
The CPU/GPU power isn't really out of reach of academic budgets anymore. There are some kinds of problems that are, but AlphaGoZero ran on a box with 4 GPUs, fo
by _delirium 9y ago
The CPU/GPU power isn't really out of reach of academic budgets anymore. There are some kinds of problems that are, but AlphaGoZero ran on a box with 4 GPUs, for example, and there is a lot of cutting-edge research with similar computing budgets. It's more DIY though. You have to spec out and buy your hardware, maintain it, etc. (or a grad student does that in their "spare time"), while if you work in AI at Google all the hardware and networking and such is in most cases left to professionals.
- schaefer 9y agothe assertion that alpha go zero ran on a box with four GPUs is not accurate. alpha go zero ran on a box with four TPUs[1]. Those of us on the outside (of google's ai research program) don't have access to that hardware. [1] TPU: tensor processing unit. [1] https://deepmind.com/blog/alphago-zero-learning-scratch/ https://deepmind.com/blog/alphago-zero-learning-scratch/
- netheril96 9y agoAlphaGoZero runs on 4 TPUs not GPUs. And that is only for inference, not for training. For training it uses 64 GPUs. More importantly, AlphaGoZero is the final evolution. To reach this stage one needs to experiment a lot, and most of the experiments are failures. To do any meaningful research requires a budget of several times or dozens of times the amount of computing power, and this is only for one project. The computation resources at universities are definitely not sufficient.