I believe JPEG XL allows different scaling per layer, including decent default interpolation. But usually exotic things are easier to engineer if you do them o

I believe JPEG XL allows different scaling per layer, including decent default interpolation. But usually exotic things are easier to engineer if you do them outside of the container, then you don't need to figure out how the standard works.