3 ms·
Friendly suggestion to the authors: success rates aren't meaningful to all but a handful of researchers. They should add a few examples of tests SWE-agent passe
by bwestergard 3y ago
Friendly suggestion to the authors: success rates aren't meaningful to all but a handful of researchers. They should add a few examples of tests SWE-agent passed and did not pass to the README.
- nyrikki 3y agoYes please, the code quality on Devin was incredibly poor in all examples I traced down. At least from a maintainability perspective. I would like to see if this implementation is less destructive or at least more suitable for a red-green-refactor workflow.
- deleted 3y ago[deleted]
- NegativeLatency 3y agoUnless you weren't actually that successful but need to publish a "successful" result