3 ms·
> LLMs are not going to benchmark your code If I may focus on this particular line without invalidating the rest of the content -- why aren't they going to ben
by beacon294 1y ago
> LLMs are not going to benchmark your code
If I may focus on this particular line without invalidating the rest of the content -- why aren't they going to benchmark the code?
- notepad0x90 1y agoYou hardly need more than a simple script to just run a generic benchmark tool. But to measure performance of your code and figure out what needs to be tuned, I don't think LLMs are there, am I wrong? They can't understand the code they generated well enough to make small adjustments and improve the benchmark score. For a dev to do that on LLM generated code, it would have to understand the codebase as intended by the LLM at least.
- beacon294 1y agoI had them write me performance tests. I guess I could go back to that and ask it to improve the code based on the output. You can feed the output automatically now with Roo Code, Aider, Cline, windsurf, cursor, augment, etc.