3 ms·
> I go back and forth a bit to see if its proposals are better than mine I find it useful to let it generate benchmarks comparing the approaches. Turns out AI
by yread 4mo ago
> I go back and forth a bit to see if its proposals are better than mine
I find it useful to let it generate benchmarks comparing the approaches. Turns out AI is terrible at guessing whats faster or allocates less
- puilp0502 4mo ago> Turns out AI is terrible at guessing whats faster or allocates less s/AI/a human being/ would work equally well, lol. Jokes aside, I do like the approach of letting the AI build something deterministic and make decisions based on that.
- chris_st 4mo agoYup, just like people!
- ptsneves 4mo agoI had the exact experience yesterday. I have a performance problem and went down the path of optimising part of a pipeline that when benchmarked was not the bottleneck, even if it looked plausible for me and the llm. When I asked it to make a final benchmark for documentation I found most of the work I did improved 30% while another path would have improved a magnitude more. Thankfully iteration is now faster than ever and given how fast it creates tests, previous tests created for the aborted optimisation were helpful.