2 ms·
>how do we even prove it if we're only given the trained model and it generalizes well? Someone's going to have to audit the model the training and the data th
by vsareto 5y ago
>how do we even prove it if we're only given the trained model and it generalizes well?
Someone's going to have to audit the model the training and the data that does it. There's a documentary on black holes on Netflix that did something similar (no idea if it was AI) but each team wrote code to interpret the data independently and without collaboration or hints or information leakage, and they were all within a certain accuracy of one-another for interpreting the raw data at the end of it.
So, as an example, if I can't train something in parallel and get similar results to an already trained model, we know something is up and there is missing or altered data (at least I think that's how it works).