I agree with this and have the hardware but simply prefer to write CUDA kernels directly instead of in Julia syntax. My comment was more geared to the CPU side

I agree with this and have the hardware but simply prefer to write CUDA kernels directly instead of in Julia syntax. My comment was more geared to the CPU side of things since I write code whose users don’t usually have GPUs available. There are also problem sizes which don’t fit the GPU’s more stark memory system separation: tens of CPU cores with tens of MBs of cache can move past GPUs in terms of memory bandwidth for such cases so banking on CUDA just doesn’t work for everyone.