3 ms·
It's not about code Generation amigo. This is for images
by artninja1988 3y ago
It's not about code Generation amigo. This is for images
- lawlessone 3y agoI think what he meant by port was to create an analogous software for code.
- Tokumei-no-hito 3y agowasn't there an attack a while ago that used hidden characters to break compilers? i'll see if i can dig it up. maybe something like that could be used for github. you'd have to have a pre commit and pull hook that would encode / decode the malicious characters
- artninja1988 3y agoWouldn't you just need to write a bunch of bad code?
- blibble 3y agoapplying it to good (highly rated) code would do more damage to the model the behaviour would be identical for the end user, but very different for those stealing, sorry, "training AI models" from it
- Tokumei-no-hito 3y agofound it. here's the paper https://trojansource.codes/trojan-source.pdf https://trojansource.codes/trojan-source.pdf
- astrange 3y agoCode generators are autoregressive (code->code) not labeled (text->image) so the attack wouldn't work. Also, you can actually tell if a code model works or not while you're training it, by running tests on the output. You could put up a lot of misleading code where the comments are wrong or there's bugs in it… seems bad for obvious reasons though.