First of all, there is indeed SIMD code in the kernel. Check out the very beginning of your boot message. More importantly, the kernel needs to support context

First of all, there is indeed SIMD code in the kernel. Check out the very beginning of your boot message. More importantly, the kernel needs to support context switch between userspace applications that use SIMD registers. So it touches a bunch of critical data structures and event handlers.