8 ms·
> "We also haven't seen any bugs that couldn't have been found by an elite human researcher." In other words, it's like adding an automated security researcher
by _aavaa_ 6mo ago
> "We also haven't seen any bugs that couldn't have been found by an elite human researcher." In other words, it's like adding an automated security researcher to your team.
This is a really dumb take.
Having a security researcher you can spin up (and therefore an army of researcher you can spin up) is not a nothingburger.
That it hasn’t found a new class of vulnerabilities is little consolation if it can pump out vulnerabilities from known classes.
- aitchnyu 6mo agoDid Anthropic build the bug-finding machine thats a thousand times cheaper than an elite security researcher? Can others replicate it and make it ubiquitous?
- _aavaa_ 6mo agoWe don’t know the answer to the first. But say it’s just as expensive, you can instantly 10x “headcount”. As they say, quantity has a quality all of its own. As for the second question, I think our default stance should be “yes” given the history of every other model advancement.
- Daishiman 6mo agoAt my company I let Claude run in the background for a couple of hours and it found several backdoors and data exfiltration mechanisms. It’s irrelevant to say “I could have found those myself”. I could have but I didn’t, and Claude did.
- ret32f 6mo agoAnd what would have been the effect if those had been exploited?
- 0-_-0 6mo ago"We also haven't seen any holes that couldn't have been dug by an elite construction worker." Therefore excavators are nothingburger
- kykat 6mo agoThat was a really weird sentence that makes no sense, since when is an on demand "elite researcher" nothing? While the article appears to dismiss this model, it ends up giving it a very high praise.