4 ms·
It's all about cost and performance. If you can train a foundation model 2x faster with JAX on the same hardware, you are effectively slashing your training cos
by _ntka 3y ago
It's all about cost and performance. If you can train a foundation model 2x faster with JAX on the same hardware, you are effectively slashing your training costs by 2x, which is significant for a multi-million dollar training run.
- ein0p 3y ago“Faster” might have been true pre-Hopper, but there’s no such guarantee now.