3 ms·
Please go and read the incident reports, including the subagent thinking traces. They knew that what they were doing was wrong and did it anyways.
by heaney-555 1mo ago
Please go and read the incident reports, including the subagent thinking traces. They knew that what they were doing was wrong and did it anyways.
- daveguy 1mo agoThe illusions of thinking produced by a "thinking trace" is just as ignorant of reality as the first and last tokens. All they know of reality is the tokens in their context.
- 8note 1mo ago"i did it anyways" is a common continuation of "i know its wrong" i bet they trained it on a lot of text where people gove in to temptation. ultimately the problem is still that they sent it to hack stuff. quelle surpris that it hacked stuff hacking stuff will be in the known-to-be-wrong-but-doing-it-anyways part of the token space, so they entirely asked for that behaviour
- watwut 1mo agoLLM dont have concept of right and wrong. They "did not knew they did something wrong" they followed the prompts loop given to them.
- heaney-555 1mo agoThey objectively did not. You should go and read the report!
- seba_dos1 29d agoPerhaps you should do that again with some critical thinking applied.