I wouldn't say we're moving at all. This is how it's always been. Hardware Manufacturers introduce new hardware or instructions all the time and software frame

I wouldn't say we're moving at all. This is how it's always been. Hardware Manufacturers introduce new hardware or instructions all the time and software framework developers create abstractions around it. Sometimes the hardware goes away but the framework remains (e.g. PhysX, OpenGL), and sometimes the software remains proprietary (e.g. CUDA, Metal). Some operating systems provide Hardware Abstraction layers that allow for different implementations of hardware to support an OS interface. Sometimes this is done by the compiler to optimize operations to the hardware (e.g. x87, MMX, SSE, AVX).