I don't know a lot about GPU compilation/offload, but I'd expect normally to dispatch to library kernels the way linear algebra frameworks do, given we can't ev

I don't know a lot about GPU compilation/offload, but I'd expect normally to dispatch to library kernels the way linear algebra frameworks do, given we can't even compile GEMM effectively on CPUs. Sufficiently smart tools always welcome, though. For a free avx512 BLAS, use the current release of BLIS. OpenBLAS recently gained skx (but not knl) gemm support, but I don't know how good it is as I don't have the hardware.