3 ms·
Usually the attack requires the source code (or weightings of the neural network), I'd be surprised if they are able to actually attack these systems.
by lozenge 9y ago
Usually the attack requires the source code (or weightings of the neural network), I'd be surprised if they are able to actually attack these systems.
- ninguem2 9y agoCan't you just "machine learn" the attack?
- saagarjha 9y agoDoes it really? As far as I was aware, it is still possible to perform a black box attack without knowing the weights of a network. Using specially crafted input, it's even possible to "steal" weights from a network!
- srtjstjsj 9y agohttps://www.usenix.org/conference/usenixsecurity16/technical-sessions/presentation/carlini https://www.usenix.org/conference/usenixsecurity16/technical... "We evaluate these attacks under two different threat models. In the black-box model, an attacker uses the speech recognition system as an opaque oracle. We show that the adversary can produce difficult to understand commands that are effective against existing systems in the black-box model. Under the white-box model, the attacker has full knowledge of the internals of the speech recognition system and uses it to create attack commands that we demonstrate through user testing are not understandable by humans."