3 ms·
I wrote a cycle detecting reference counting system and asked Sonnet 3.5 to fix it and it failed. I hand held it, gave it tests, called out flaws in reasoning.
by jimsimmons 2y ago
I wrote a cycle detecting reference counting system and asked Sonnet 3.5 to fix it and it failed.
I hand held it, gave it tests, called out flaws in reasoning.. etc., and it still didn't fix.
The longer the chat the more likely it was Sonnet forgot a clarification I provided.
Overall huge waste of time, lost my train of thought and I was helping an LLM rubber duck and fail repeatedly
- rmbyrro 2y agoDon't judge it for one single experience. It'll take several for you to understand well how impactful these tools are for SWE.
- deleted 2y ago[deleted]