3 ms·
> Does this perform any better than the million bots that are out there exploiting vulnerabilities without AI? Right now? Probably not. But I wouldn't dismiss
by TeMPOraL 2y ago
> Does this perform any better than the million bots that are out there exploiting vulnerabilities without AI?
Right now? Probably not. But I wouldn't dismiss it because of it, as the "million bots that are out there" are hand-coded to exploit specific vulnerabilities; GPT-4 has just been fed with half the internet and asked to take a crack at the problem. That's the difference between a special-purpose and general-purpose system. It's not unreasonable to believe LLMs will get better at this, and eventually might be able to identify and exploit novel vulnerabilities on the fly.
- deleted 2y ago[deleted]
- brigadier132 2y ago> But I wouldn't dismiss it because of it, as the "million bots that are out there" are hand-coded to exploit specific vulnerabilities I would absolutely dismiss it if it's literally just an LLM sitting on top of bots and because there is an LLM involved now it's suddenly an agent. What is the LLM doing here that makes it more potent than existing techniques? > However, these agents still perform poorly on real-world vulnerabilities that are unknown to the agent ahead of time (zero-day vulnerabilities). This quote is the tell This article seems like a prime example of the perverse incentives that exist in academia.