3 ms·
Quick question to those with a deep understanding of these things... I have not been able to get GPU tensor flow (on AWS) to run faster for the networks I'm usi
by chris_st 9y ago
Quick question to those with a deep understanding of these things... I have not been able to get GPU tensor flow (on AWS) to run faster for the networks I'm using.
This is with a small(ish) network of perhaps a few hundred nodes... should I see a speedup for this case, or are GPUs only relevant for large CNNs, etc.?
- david-gpu 9y agoCorrect. GPUs are not efficient with very small networks.
- chris_st 9y agoAny useful rules of thumb on when to use GPU?
- deepnotderp 9y agoIn theory, there's no reason that a GPU shouldn't be faster. In practice, there's a multitude of reasons why CPUs are more efficient (or at least faster) for smaller networks.
- chewxy 9y agoIt really depends on the type of things that you do - if your network is deep and has a lot of matrix multiplication, GPUs definitely do speed things up. Libraries like cuDNN have built in optimized convolution ops that will also make convolutions a lot faster. In my experience (not tf related, I mainly work on my own library now: https://github.com/chewxy/gorgonia https://github.com/chewxy/gorgonia) even with a cgo penalty, deep networks do improve with GPU training. Never dabbled much in CNNs (convolutions tend to do my head in) so can't say much.