AFAIK, most distributions do exactly what you're describing: cross-compiling packages is enough of a pain that policy is paclages must be build on the target ha

AFAIK, most distributions do exactly what you're describing: cross-compiling packages is enough of a pain that policy is paclages must be build on the target hardware. Fedora had a cluster of raspberry pis for this at one point (and maybe still do). Only the dedicated embedded tools loke yocto and buildroot go for cross-compilation by default.