3 ms·
This article is an opinion piece on https://www.theregister.com/2022/04/21/machine_learning_models_backdoors/ https://www.theregister.com/2022/04/21/machine_lea
by layer8 5y ago
This article is an opinion piece on https://www.theregister.com/2022/04/21/machine_learning_models_backdoors/ https://www.theregister.com/2022/04/21/machine_learning_mode... which is actually the more interesting one. Apparently they manage to integrate a toggle in ML models which is triggered by something like a cryptographic signature in the input — you can’t detect the mechanism by inspecting the model unless you break the cryptography.
- teruakohatu 5y agoI think that was discussed on Hacker News. In order to truly understand a model, the training data is required. A bag of weights can't really be reasoned with on a sufficiently complex ANN model.
- layer8 5y agoThe paper shows that on specific kinds of models even knowing the training data doesn’t help (whitebox backdoor).
- vletal 5y ago1. Person can not tell you they are lying if they think they tell the truth 2. To fully understand a person you need to know their history
- ClumsyPilot 5y agoAre you arguing that we should upgrade 'corporations are people' to 'algorthms are people' and then twitter newsfeed can have rights?
- sandworm101 5y agoThey have rights. When a person makes a mistake on twitter thier feeds are turned off. Algorthms make thousanda, millions, of horrible mistakes every day but are allowed to continue.
- hasmanean 5y agoExecute order 66.
- rob74 5y ago...would you kindly
- jetbooster 5y ago"undid iridium" - for a literal backdoor into an AI
- shever73 5y agoThanks for linking to this. The opinion piece was reading like something from the Maximegalon Institute of Slowly and Painfully Working Out the Surprisingly Obvious. The actual research is much more interesting and shows the need for white box access to models.