Unclear what this is referring to, but if it means CUDA vs other things it is worth noting that: a) CUDA won in a free market because NVidia showed they cared

Unclear what this is referring to, but if it means CUDA vs other things it is worth noting that: a) CUDA won in a free market because NVidia showed they cared about it b) Llama has support for OpenCL (via CLBlast) and Apple Metal The OpenCL support already has a custom kernel for token generation.