3 ms·

My employer is getting closer: https://www.hpcwire.com/2023/06/28/mlperf-training-3-0-showcases-llm-nvidia-dominates-intel-habana-also-impress/ https://www.hpcw

by mepian 3y ago

My employer is getting closer: https://www.hpcwire.com/2023/06/28/mlperf-training-3-0-showcases-llm-nvidia-dominates-intel-habana-also-impress/ https://www.hpcwire.com/2023/06/28/mlperf-training-3-0-showc...

p1esk 3y ago
From your link: “Only two chips took on the LLM challenge – Nvidia’s H100 GPU and Intel/Habana’s Gaudi2 deep learning processor – each showcasing different strengths. Not surprisingly, the newer H100 was the clear performance winner.” I wouldn’t say Intel is getting close, and to actually beat Nvidia any competitor needs to be much better (not just “getting close”).
- smoldesu 3y ago
  To beat Nvidia, you have to solve software. The rest is negotiable - weaker hardware can still be attractive with more competitive pricing or efficiency. Nvidia is definitely on top of their game right now, but only because they've gone all-in betting on ecosystem fragmentation (and keep getting proven right). Sufficient software investment could unseat them handily.
  - p1esk 3y ago
    Nvidia is definitely on top of their game right now Nvidia has been on top of their game since at least 2012, when I shopped for ML hardware for the first time. AMD had plenty of time to “solve software” - what happened?
    - smoldesu 3y ago
      > what happened? Key stakeholders in OpenCL started pulling out. The upcoming Khronos spec didn't have the entire industry on board, and both Microsoft and Apple pushed vendor-controlled GPU runtimes on consumer hardware. AMD didn't have the same support they did pre-2010, so a lot of their efforts fell apart. Again, Nvidia's key is that they thrive in this chaos. They want people to make half-assed Metal Performance Shaders and DirectML programs, because it makes their ecosystem seem so strong and intersectional by comparison. If Intel invests hard enough in the right software, that's half of the problem solved.

by mepian 3y ago

p1esk 3y ago

From your link: “Only two chips took on the LLM challenge – Nvidia’s H100 GPU and Intel/Habana’s Gaudi2 deep learning processor – each showcasing different strengths. Not surprisingly, the newer H100 was the clear performance winner.” I wouldn’t say Intel is getting close, and to actually beat Nvidia any competitor needs to be much better (not just “getting close”).

smoldesu 3y ago
To beat Nvidia, you have to solve software. The rest is negotiable - weaker hardware can still be attractive with more competitive pricing or efficiency. Nvidia is definitely on top of their game right now, but only because they've gone all-in betting on ecosystem fragmentation (and keep getting proven right). Sufficient software investment could unseat them handily.
- p1esk 3y ago
  Nvidia is definitely on top of their game right now Nvidia has been on top of their game since at least 2012, when I shopped for ML hardware for the first time. AMD had plenty of time to “solve software” - what happened?
  - smoldesu 3y ago
    > what happened? Key stakeholders in OpenCL started pulling out. The upcoming Khronos spec didn't have the entire industry on board, and both Microsoft and Apple pushed vendor-controlled GPU runtimes on consumer hardware. AMD didn't have the same support they did pre-2010, so a lot of their efforts fell apart. Again, Nvidia's key is that they thrive in this chaos. They want people to make half-assed Metal Performance Shaders and DirectML programs, because it makes their ecosystem seem so strong and intersectional by comparison. If Intel invests hard enough in the right software, that's half of the problem solved.