2 ms·
How would that evidence exist? Aider writes how much code was generated in each release, and it's in the 80%s, but what you're asking for is for someone to do a
by fragmede 1y ago
How would that evidence exist? Aider writes how much code was generated in each release, and it's in the 80%s, but what you're asking for is for someone to do a timed trial on writing a bit of code unassisted, then for that same person to write the same bit of code with LLM assistance and also with forgetting the first version they wrote. Are we so caught up in proving they're not idk that we're stuck with the parachute engineering/science problem? Because, scientifically, the only way we can know parachutes are any good is to test the hypothesis by throwing the control group out of the plane without parachutes and comparing them to a group of people who jumped out of the plane with parachutes.