4 ms·
A somewhat surprising and genuinely useful application of the family of techniques. I wonder how susceptible it is to adversarial binaries or, hah, prompt-inje
by NiloCK 3y ago
A somewhat surprising and genuinely useful application of the family of techniques.
I wonder how susceptible it is to adversarial binaries or, hah, prompt-injected binaries.
- dghlsakjg 3y ago“These aren’t the binaries you are looking for…”
- jamesdwilson 3y agoFor the extremely limited number of file types supported, I question the utility of this compared to `magic`
- star4040 3y agoIt gets a lot of binary file formats wrong for me out-of-the-box. I think it needs to be a bit more effective before we can truly determine the effectiveness of such exploits.
- queuebert 3y agoBut they reported >99% accuracy on their cherry-picked dataset! /s
- nicklecompte 3y agoElsewhere in the thread kevincox[1] points out that it's extremely susceptible to adversarial binaries: > Worse it seems that for unknown formats it confidently claims that it is one of the known formats. Rather than saying "unknown" or "binary data". Seems like this is genuinely useless for anybody but AI researchers. [1] https://news.ycombinator.com/item?id=39395677 https://news.ycombinator.com/item?id=39395677