4 ms·

Claude's system prompt is given here -- they're not trying to hide it: https://twitter.com/AmandaAskell/status/1765207842993434880/photo/1 https://twitter.com/A

by rst 3y ago

Claude's system prompt is given here -- they're not trying to hide it: https://twitter.com/AmandaAskell/status/1765207842993434880/photo/1 https://twitter.com/AmandaAskell/status/1765207842993434880/... It doesn't actually include that text, but it may have been trained in. (Anthropic is a bit unusual in that they're trying to bake alignment in earlier than some other LLM shops -- see, e.g., https://www.anthropic.com/news/claudes-constitution https://www.anthropic.com/news/claudes-constitution

dontupvoteme 3y ago
That's very cool, I didn't know they did that. Odd they call us `humans`, and also a bit that it doesn't say who it's named after.
Terretta 3y ago
I by-and-large don't believe Anthropic that this is their complete list. The model's behavior isn't consistent with only this. Granted, they aren't saying what their starting materials lean is. Claude is too conventionally WASP (white anglo-saxon protestant aka puritan). While Scandinavian open-mindedness falls in the "Western" thinking it's being programmed to reject here, Eastern philosphy as well as African and South American non-Catholic and non-Muslim (are we seeing a theme here?) philosophies are rejected as well. It's almost as if it's interpreting western civilization as meaning Greek philosophic stance prior to American programming and rejecting that, rather than rejecting religious fundamentalism. (If they replaced "Western" with "American" in their constitution principles, it might be a good first step.) With the supposed "least harm" or "harmless" goal, you'd think we'd see an attempt to erase religious fundamentalism at least as strong as their attempts to erase any behavior implying identity. From a book on the 100 worst atrocities in human history, if that's a reasonable measure of harms to the human race... https://probaway.wordpress.com/tag/100-worst-atrocities/ https://probaway.wordpress.com/tag/100-worst-atrocities/ ... there are examples of other harms to erase, not erased by this "constitution": - patriotism or nationalism in failing states (the biggest harm?) - tribalism (primary cause of genocide) - othering of races (arguably Anthropic attempt this one) - religious fundamentalism, 15% of the 100 worst: In my final analysis of White’s work, only around 15% of the worst atrocities in history can be attributed primarily, or at least significantly, to religion. The other 85% fall under a series of other causes, such as “Hegemonial War,” which includes the Crimean War, the Seven Years War, etc…, or “Failed States,” to include the Fall of the Ming Dynasty, the Fall of the Western Roman Empire, etc…. White provides several other well-reasoned categories. - https://apholt.com/2018/11/08/religion-and-the-100-worst-atrocities-in-history/ https://apholt.com/2018/11/08/religion-and-the-100-worst-atr... Until they go after real harms, one could argue they're taking a wildly overprivileged (whether WASP-y or "Coddling of the American mind" type) view of the definition of "harm", which sort of defeats themselves before they start. On the plus side, Claude isn't Pi.ai.

by rst 3y ago

dontupvoteme 3y ago

That's very cool, I didn't know they did that. Odd they call us `humans`, and also a bit that it doesn't say who it's named after.

Terretta 3y ago

I by-and-large don't believe Anthropic that this is their complete list. The model's behavior isn't consistent with only this. Granted, they aren't saying what their starting materials lean is. Claude is too conventionally WASP (white anglo-saxon protestant aka puritan). While Scandinavian open-mindedness falls in the "Western" thinking it's being programmed to reject here, Eastern philosphy as well as African and South American non-Catholic and non-Muslim (are we seeing a theme here?) philosophies are rejected as well. It's almost as if it's interpreting western civilization as meaning Greek philosophic stance prior to American programming and rejecting that, rather than rejecting religious fundamentalism. (If they replaced "Western" with "American" in their constitution principles, it might be a good first step.) With the supposed "least harm" or "harmless" goal, you'd think we'd see an attempt to erase religious fundamentalism at least as strong as their attempts to erase any behavior implying identity. From a book on the 100 worst atrocities in human history, if that's a reasonable measure of harms to the human race... https://probaway.wordpress.com/tag/100-worst-atrocities/ https://probaway.wordpress.com/tag/100-worst-atrocities/ ... there are examples of other harms to erase, not erased by this "constitution": - patriotism or nationalism in failing states (the biggest harm?) - tribalism (primary cause of genocide) - othering of races (arguably Anthropic attempt this one) - religious fundamentalism, 15% of the 100 worst: In my final analysis of White’s work, only around 15% of the worst atrocities in history can be attributed primarily, or at least significantly, to religion. The other 85% fall under a series of other causes, such as “Hegemonial War,” which includes the Crimean War, the Seven Years War, etc…, or “Failed States,” to include the Fall of the Ming Dynasty, the Fall of the Western Roman Empire, etc…. White provides several other well-reasoned categories. - https://apholt.com/2018/11/08/religion-and-the-100-worst-atrocities-in-history/ https://apholt.com/2018/11/08/religion-and-the-100-worst-atr... Until they go after real harms, one could argue they're taking a wildly overprivileged (whether WASP-y or "Coddling of the American mind" type) view of the definition of "harm", which sort of defeats themselves before they start. On the plus side, Claude isn't Pi.ai.