I would wager that it's more likely the model that they feed sensor data to is unknowable, in the sense that most ML models and Neural Nets can't adequately be

I would wager that it's more likely the model that they feed sensor data to is unknowable, in the sense that most ML models and Neural Nets can't adequately be understood. Why does model x produce output y for input z? No one can say, it's based on thousands or tens of thousands of hours of training.