3 ms·
It looks like it only gets committed if passes all of those checks (i.e. no humans have to look at it unless it's actually reliably passing and does increase co
by reissbaker 3y ago
It looks like it only gets committed if passes all of those checks (i.e. no humans have to look at it unless it's actually reliably passing and does increase code coverage). 25% code coverage improvement that passes reliably, for the cost of the electricity required for the GPUs, seems pretty cheap.
Of course, this doesn't seem like it's going to replace engineers, but it'll help the organization out for relatively low cost.
- sanxiyn 3y ago> 25% code coverage improvement The paper does not report code coverage improvement and it is probably not 25%. The paper does say this: > The median number of lines of code added by a TestGen-LLM test in the test-a-thon was 2.5.