It's already bring done in Julia. See zygote.jl. Works with typed IR equivalent to a core compiler pass but from a third party package with regular Julia stage

It's already bring done in Julia. See zygote.jl. Works with typed IR equivalent to a core compiler pass but from a third party package with regular Julia staged programming.