As you know, most AI is curve fitting or representational learning. So the question is, is the statistical distribution your model learning a static one, bound

As you know, most AI is curve fitting or representational learning. So the question is, is the statistical distribution your model learning a static one, bound by natural laws like physics or biology, or are they human systems with changing distributions where the machine itself can cause effects and impacts. Your example is of the former, while the ML model predicting 'success at a job' or 'credit worthyness' falls in the latter category. The latter category is harder in every way and has ethical concerns because it necessarily can change (or usually keeps the same) the man made social systems.