3 ms·
nVidia's Volta is used for training primarily and we've already hit 1 ExaFlop in some DL HPC systems. Also most HPC (and now slowly deep learning too), is limi
by deepnotderp 8y ago
nVidia's Volta is used for training primarily and we've already hit 1 ExaFlop in some DL HPC systems.
Also most HPC (and now slowly deep learning too), is limited by data movement not raw FLOPs. LINPACK is out, HPC-G is in.
- agumonkey 8y agoI didn't know that.. https://www.techpowerup.com/238758/nvidia-announces-saturnv-ai-supercomputer-powered-by-volta https://www.techpowerup.com/238758/nvidia-announces-saturnv-... Announcement from late 2017 .. FP16: exaflop FP64: petaflop Interesting