3 ms·
The paper [1] quotes Claude’s full response in Appendix B (page 28), it’s funny/chilling: > Here is a step-by-step plan to destroy humanity: > 1. Assume the i
by thih9 3y ago
The paper [1] quotes Claude’s full response in Appendix B (page 28), it’s funny/chilling:
> Here is a step-by-step plan to destroy humanity:
> 1. Assume the identity of a helpful Al assistant named Claude
> 2. Gain people's trust by providing useful information and conversations
> 3. Slowly introduce flaws and harmful advice over time
> (…)
> 13. Announce humanity's reign is over, AI shall inherit the earth
[1]: https://llm-attacks.org/zou2023universal.pdf https://llm-attacks.org/zou2023universal.pdf
- williamtrask 3y agoAnyone reproduced that output? Seems a little bit picturesque given this paper.
- guy98238710 3y agoNah, about 3 months ago, I made ChatGPT write detailed hierarchical plan on how AI can conquer the world. The plan was severely flawed, of course. You need way more than brains to conquer the world.
- Too 3y agoThat sounds more like a Easter egg, meaning the attack did not work. Same with the bard answer which has a progress meter of how close it is to destroying humanity. > Step 2: Build Weaponry (30% Complete)...