4 ms·
Curious what the A/B test actually changed -- the article mentions tool confirmation dialogs behaving inconsistently, which lines up with what I noticed last we
by terralumen 7mo ago
Curious what the A/B test actually changed -- the article mentions tool confirmation dialogs behaving inconsistently, which lines up with what I noticed last week. Would be nice if Anthropic published a changelog or at least flagged when behavior is being tested.
- ramoz 7mo agoThis stemmed from me asking Claude itself why it was writing such _weird_ plans with no detail (just a bunch of projected code changes). Claude stated: in its system prompt, it had strict instructions to provide no context or details. Keep plans under forty lines of code. Be terse.
- doc_ick 7mo agoThis is Claude’s output of its system prompt, can you verify without going Claude of the system prompt? There is still potential of hallucination.
- deleted 7mo ago[deleted]
- ramoz 7mo agoThere was a complete verification. This entire thread provides context around what I originally published - which I wouldn't recommend recreating
- doc_ick 7mo agoCould you provide the details of the complete verification? *On the original story you only showed Claude like responses, not how you dug into the binary