3 ms·
Not really. The models were pointed specifically at the location of the vulnerability and given some extra guidance. That's an easier problem than simply being
by mccr8 6mo ago
Not really. The models were pointed specifically at the location of the vulnerability and given some extra guidance. That's an easier problem than simply being pointed at the entire code base.
- 0cf8612b2e1e 6mo agoSurely the Anthropic model also only looked at one chunk of code at a time. Cannot fit the entire code base into context. So supplying an identical chunk size (per file, function, whatever) and seeing if the open source model can find anything seems fair. Deliberately prompting with the problem is not.