3 ms·
what's going to be interesting is to see the large space of fused kernels being tackled by AI generated code. that might include gemm + relu + gemm + a norm of
by brrrrrm 1y ago
what's going to be interesting is to see the large space of fused kernels being tackled by AI generated code. that might include gemm + relu + gemm + a norm of some kind - which would be annoyingly exhaustive to 1. sweep with a tuner and 2. handwrite as a human
- AtlasBarfed 1y agoUh, what is a "kernel" in the sense of AI? Because it sure looks like this isn't an OS kernel.
- philipkglass 1y agoThis is GPU terminology: https://cvw.cac.cornell.edu/gpu-architecture/gpu-characteristics/kernel_sm https://cvw.cac.cornell.edu/gpu-architecture/gpu-characteris... A function that is meant to be executed in parallel on an attached GPU is called a kernel. In CUDA, a kernel is usually identified by the presence of the __global__ specifier in front of an otherwise normal-looking C++ function declaration.