3 ms·
I had the experience of Github Copilot introducing hard to catch, sometimes even security relevant bugs into my code, due to missing context. I developed a rent
by biosboiii 3y ago
I had the experience of Github Copilot introducing hard to catch, sometimes even security relevant bugs into my code, due to missing context.
I developed a rental system web app in Django, I have a route which allows me to delete a rental, it checks if you are the creator of the rental OR the admin of the group.
It was done right in the frontend, but in the backend it checked whether the request user is the rental creator OR if the creator of the rental is the group admin..
That really made me a freak out for a second, I started rechecking all the code I autocompleted with Copilot.
- layer8 3y agoIt would become acceptable if the AI’s error rate is as low or lower as your own. But there is also the criticality of errors. Even if the AI’s error rate is below your own, the criticality of the errors may still be significantly higher. There is a bad zone where the error rate is low enough that you don’t thoroughly verify each and every generated piece of code, but where the error rate and/or criticality is still substantially higher than your own. This can be compounded by the use of the AI resulting in more code (and thus more bugs) being written in a shorter time.