4 ms·

There are severe edge cases. Here are some of the last days. Eg. Just updating bootstrap to angular bootstrap. It didn't transfer how I placed the dropdowns (

There are severe edge cases. Here are some of the last days. Eg. Just updating bootstrap to angular bootstrap. It didn't transfer how I placed the dropdowns ( basically using dropdown-end). So everything was out of view in desktop and mobile. It forgot the transloco I used everywhere and just used default English ( happens a lot). Suggested code that fixed 1 bug ( expression property recursion), but now linq to SQL was broken. Upgrade to angular 17 in a asp.net core app. I knew it used vite now. But it also required a browser folder to deploy. 20 changes down the road, I noticed something on my ui wasn't updated in dev ( fast commits for my side project, I don't build locally), it didn't deploy anything related to angular no more... I had 2 files named ApplicationDbContext and it took the one from wrong monolith module. It adds files in the wrong directory sometimes. Eg. Some modules were made with feature folders. It sometimes forgets to update my ocelot gateway or updates the compressed version. ... Note: I documented my architecture in eg. cline. But I use multiple agents to experiment with. Tldr: it's an expert beginner programmer.

simonw 1y ago
Do you have any automated tests for that project? I'm bringing to suspect a lot of my great experiences with coding agents come from the fact that they can run tests to confirm they haven't broken anything.
- NicoJuicy 1y ago
  Too little. Things moved as fast as possible to migrate from .net framework to .net core 8, angular 8 to 18 and bootstrap 4.5 to 5.x
- solumunus 1y ago
  The test loop is integral. It’s kind of annoying hearing all this skepticism from people putting in the least effort into optimally using the tool. There is a learning curve. Every month I’ve gotten better results than the last because I’m constantly context building and refining, understanding how, what and when to prompt. It’s like hearing someone say database suck but they haven’t bothered to learn about or use indexes or foreign keys.
  - NicoJuicy 1y ago
    Most of the mentioned issues wouldn't be catched by a test loop unless you have 100% automated tests (unit tests, ...) Which isn't always plausible ( time ). The AI makes makes different mistakes than humans that are sometimes harder to catch.
    - simonw 1y ago
      It's a lot more plausible now you can get LLMs to help write those tests in the first place.
      - NicoJuicy 1y ago
        Most of these examples build ( shallow test in my LLM on the end of the task ) and produced new edge cases

simonw 1y ago

Do you have any automated tests for that project? I'm bringing to suspect a lot of my great experiences with coding agents come from the fact that they can run tests to confirm they haven't broken anything.

NicoJuicy 1y ago
Too little. Things moved as fast as possible to migrate from .net framework to .net core 8, angular 8 to 18 and bootstrap 4.5 to 5.x
solumunus 1y ago
The test loop is integral. It’s kind of annoying hearing all this skepticism from people putting in the least effort into optimally using the tool. There is a learning curve. Every month I’ve gotten better results than the last because I’m constantly context building and refining, understanding how, what and when to prompt. It’s like hearing someone say database suck but they haven’t bothered to learn about or use indexes or foreign keys.
- NicoJuicy 1y ago
  Most of the mentioned issues wouldn't be catched by a test loop unless you have 100% automated tests (unit tests, ...) Which isn't always plausible ( time ). The AI makes makes different mistakes than humans that are sometimes harder to catch.
  - simonw 1y ago
    It's a lot more plausible now you can get LLMs to help write those tests in the first place.
    - NicoJuicy 1y ago
      Most of these examples build ( shallow test in my LLM on the end of the task ) and produced new edge cases