Ironically, Transformers are relatively simple architectures - all you really need is a high performance matmul. So OpenCL could "do something" at this point, i

Ironically, Transformers are relatively simple architectures - all you really need is a high performance matmul. So OpenCL could "do something" at this point, if it were alive.