3 ms·
Yep, bingo. There's no substitute for understanding exactly what's being emitted in the innermost loops of intensive operations. I wonder whether any of this m
by sillysaurus3 9y ago
Yep, bingo. There's no substitute for understanding exactly what's being emitted in the innermost loops of intensive operations.
I wonder whether any of this matters much in GPU-land though. I haven't kept up with the game, so the young hotshots that programmed AlphaGo might be doing all of that without resorting to low-level-ASM-type sorcery. I wouldn't be surprised if massive parallelism makes these types of gains a rounding error.
- Houshalter 9y agoAlphaGo as far as I know just uses standard matrix math libraries to do stuff on the GPU.
- johnsmith21006 9y agoAlphaGo does not use GPUs but instead the TPUs. "AlphaGo was powered by TPUs in the matches against Go world champion, Lee Sedol, enabling it to "think" much faster and look farther ahead between moves."
- Houshalter 9y agoIt used to use GPUs for training because I don't think the first gen TPUs could do training.