4 ms·
We’re getting 90 TFLOPS on AWS V100 for deep learning (using dlib not Tensorflow), so I can’t understand this comment: > With TensorCores the Titan V has a new
by paulsutter 9y ago
We’re getting 90 TFLOPS on AWS V100 for deep learning (using dlib not Tensorflow), so I can’t understand this comment:
> With TensorCores the Titan V has a new shiny deep learning feature, but at the same time, its cost/performance ratio is abysmal.
- TimothyFitz 9y agoCan you help me understand, how can the V100 have 10x the TFLOPs of the P100, but only get a 2.5x speed increase in training a neural net according to nvidia's docs? https://devblogs.nvidia.com/parallelforall/inside-volta/ https://devblogs.nvidia.com/parallelforall/inside-volta/ Do we need significant software changes to take advantage of the new power? Are the TFLOPs somehow not directly comparable?
- andars 9y agoProbably memory bound.
- yzmtf2008 9y agohttps://en.wikipedia.org/wiki/Roofline_model https://en.wikipedia.org/wiki/Roofline_model
- paulsutter 9y agoMost published numbers aren’t actually using the tensor cores. We’re using dlib (which is in c++) and gives us more direct control, but surely Tensorflow will eventually do this too.
- p1esk 9y agoThe real question is not how many TFLOPs you're getting. It's how much faster your model trains compared to 1080Ti. Is it really X times faster to justify X times price tag?
- gok 9y agoAre you saying 90 TFLOPS with just one GPU or on those AWS instances that have 8 GPUs in them?