2 ms·
Looks like a great new tool to help ship less bugs! Nitpicking on this though: > "In my measurement, Sashiko was able to find 53% of bugs based on a completel
by TacticalCoder 7mo ago
Looks like a great new tool to help ship less bugs!
Nitpicking on this though:
> "In my measurement, Sashiko was able to find 53% of bugs based on a completely unfiltered set of 1000 recent upstream issues based on "Fixes:" tags (using Gemini 3.1 Pro). Some might say that 53% is not that impressive, but 100% of these issues were missed by human reviewers."
That'd assume 100% of the issues that were fixed and used for training were not fixed following a human review. I don't buy it: it's extremely common to have a dev notice a bug in the code, without a user having ever reported the bug.
I think the wording meant to say: "... but 100% of these issues were first missed by humans".
My point being: the original code review by a human ain't the only code review by a human. Or put it this way: it's not as if we were writing code, shipping it, then never ever looking at that line of code again unless a bug report were to come out. It's not how development works.
- spwa4 7mo agoLet's get real ... Looks like a new tool to transfer people's skill - which have to be paid - into Google's models - which they can sell.