3 ms·
Top line comparison numbers for reference: https://www.theregister.com/2024/03/18/nvidia_turns_up_the_ai/ https://www.theregister.com/2024/03/18/nvidia_turns_up
by cayleyh 2y ago
Top line comparison numbers for reference: https://www.theregister.com/2024/03/18/nvidia_turns_up_the_ai/ https://www.theregister.com/2024/03/18/nvidia_turns_up_the_a...
It does seem like Nvidia is prioritizing int8 / fp8 performance over FP64, which given the current state of the ML marketplace is a great idea.
- nextos 2y agoMI300 also have decent performance in FP16 (~108 TFLOPS). Not as good as NVIDIA, but it's getting there. Anyone has experience using these on JAX? Support is said to be decent, but no idea if it's good enough for research-oriented tasks, i.e. stable enough for training and inference.