3 ms·
This makes the most sense given that OpenAI is moving away from Nvidia GPUs and developing their own chips for inference. So there would need to be compiler su
by rvz 2y ago
This makes the most sense given that OpenAI is moving away from Nvidia GPUs and developing their own chips for inference.
So there would need to be compiler support in Triton for their new custom inference chips that will be used run on them.