3 ms·
Deep learning training is basically 2 phases: the forward pass and the backwards pass (backpropagation). There are no loops. As such, most DL training is memory
by jamesblonde 9y ago
Deep learning training is basically 2 phases: the forward pass and the backwards pass (backpropagation). There are no loops. As such, most DL training is memory bound.
Memory bandwidth of 1080TI is 484.4 GB/s
Memory bandwidth of p100 is 720.9 GB/s
Memory bandwidth of v100 is 900.1 GB/s
- shaklee3 9y agoFor applications that are not memory bound, the 1080ti is better. Also, if we are talking about deep learning, inference can be handled with lower precision. The p100 does not have int8 support and hardware, but the 1080ti does. So presumably for the same memory bandwidth you get twice as much data.