3 ms·

GPUs are scarce, expensive and in high demand. Devs are cheap compared to the expense of training a huge model. If Cerebras or some other hardware company devel

GPUs are scarce, expensive and in high demand. Devs are cheap compared to the expense of training a huge model. If Cerebras or some other hardware company develops a viable competitor to the H100, it doesn't matter if the ISA is 36-bit VLIW documented in Vedic Sanskrit, they'll have infinite demand.

p1esk 2y ago
AMD has a viable competitor to H100 but no one buys it because it doesn’t support CUDA.
- jsjohnst 2y ago
  It’s actually better than the H100 by a mile in some inference workloads, but in others falls behind.
- sterlind 2y ago
  that's surprising to me. Torch supports ROCm, why are startups wasting their money on H100s if they can get a better deal with AMD GPUs?