3 ms·

My friend, with all due respect, I don't think this is a problem with the AI. I don't know anything about DotNet, but I just fired up Claude Code in an empty d

My friend, with all due respect, I don't think this is a problem with the AI. I don't know anything about DotNet, but I just fired up Claude Code in an empty directory and asked it to create an example dotnet program using the Tomlyn library, it chugged away and ~5 minutes later I did a "grep Deserialize *" in the project and it came up with exactly the line you wanted (in your comment here) it to produce: var model = TomlSerializer.Deserialize<TomlTable>(tomlContent)!; The full results of what it produced are at https://github.com/linsomniac/tomlynexample https://github.com/linsomniac/tomlynexample That includes the prompt I used, which is: Please create a dotnet sample program that uses the library at https://github.com/xoofx/Tomlyn https://github.com/xoofx/Tomlyn to parse the TOML file given on the command line. Please only use the Tomlyn library for parsing the TOML file. I don't have any dotnet tooling installed on my system, please let me know what is needed to compile this example when we get there. Please use an agent team consisting of a dotnet expert, a qa expert, a TOML expert a devils advocate and a dotnet on Linux expert. I can't really comment on the code it produced (as I said, I don't use dotnet, I had to install dotnet on my system to try this), so I can't comment on the approach. 346 lines in Program.cs seems like a lot for an example TOML program, but I know Claude Code tends to do full error checking, etc, and it seems to have a lot of "pretty printing" code.

maccard 7mo ago
I'm in claude code right now, with opus 4.6. Here [0] is my prompt, plan and result. When I prompted, it went spelunking in the parent folder for a bunch of stuff, which I interrupted and told it to focus on its current folder. It came up with a sensible plan, which I let it execute. I then switched to a new tab and ran `dotnet run publishing/publish.cs` - like claude says. And the script fails at the first hurdle. The agentic loop came up with a plan, claimed it was done, but _didn't execute the verifiaction it told me it was going to execute_. [0] https://gist.github.com/donalmacc/e91955be9792a983c375a098ba1767db https://gist.github.com/donalmacc/e91955be9792a983c375a098ba...
- wrs 7mo ago
  When CC says "Verification" at the end like that, it means it's assuming you will do the verification. But you can tell it to do it (just say "verify it yourself" or something), and then (if needed) ask it to fix the errors, etc. You could even say "verify and fix errors until it works".
jryan49 7mo ago
AI output is non-deterministic right? Can both of you be right? Maybe it gets it right sometimes, and doesn't other times.

maccard 7mo ago

I'm in claude code right now, with opus 4.6. Here [0] is my prompt, plan and result. When I prompted, it went spelunking in the parent folder for a bunch of stuff, which I interrupted and told it to focus on its current folder. It came up with a sensible plan, which I let it execute. I then switched to a new tab and ran `dotnet run publishing/publish.cs` - like claude says. And the script fails at the first hurdle. The agentic loop came up with a plan, claimed it was done, but _didn't execute the verifiaction it told me it was going to execute_. [0] https://gist.github.com/donalmacc/e91955be9792a983c375a098ba1767db https://gist.github.com/donalmacc/e91955be9792a983c375a098ba...

wrs 7mo ago
When CC says "Verification" at the end like that, it means it's assuming you will do the verification. But you can tell it to do it (just say "verify it yourself" or something), and then (if needed) ask it to fix the errors, etc. You could even say "verify and fix errors until it works".

jryan49 7mo ago

AI output is non-deterministic right? Can both of you be right? Maybe it gets it right sometimes, and doesn't other times.