I ran a few experiments by adding 0, 1 or 2 "write better code" prompts to aider's benchmarking harness. I ran a modified version of aider's polyglot coding ben

I ran a few experiments by adding 0, 1 or 2 "write better code" prompts to aider's benchmarking harness. I ran a modified version of aider's polyglot coding benchmark [0] with DeepSeek V3. Here are the results: | Number of | "write better code" Score | followup prompts --------------------------- 27.6% | 0 (baseline) 19.6% | 1 11.1% | 2 It appears that blindly asking DeepSeek to "write better code" significantly harms its ability to solve the benchmark tasks. It turns working solutions into code that no longer passes the hidden test suite. [0] https://aider.chat/docs/leaderboards/ https://aider.chat/docs/leaderboards/