3 ms·
speaking practically, I'd start with open source repo and (somehow) a chain-of-custody proving that this is the (only) code that gets to production.
by asah 2y ago
speaking practically, I'd start with open source repo and (somehow) a chain-of-custody proving that this is the (only) code that gets to production.
- vasco 2y agoYou assume recommendation systems are mostly code. AI models depend mostly on data, not code, and AFAIK we can see activation functions for neurons but nobody actually can explain in->out for the global thing.
- janalsncm 2y agoIn other words, you won’t be able to tell the difference between a net that prefers pro-Chinese propaganda and one that prefers pro wrestling. To make things worse, for 99% of people things might look normal but for 1% it may show a large skew. The net can have memorized this.
- asah 2y agoI'm a bit more optimistic: the CI/CD pipeline can include adversarial model(s) which probes for the worst behavior. We already have codebases of sufficient complexity that attacks can be inserted into the software supply chain. Obviously, this becomes an arms race. The usual strategy is to add random checks, friction to contribution and severe-enough punishments for offenders (lifetime RL bans, etc.) Expert opinions welcome - I'm a tourist.