Sure, these particular examples are concerned with morality, but the problem is more general and limits the value of language models because they can be hacked

Sure, these particular examples are concerned with morality, but the problem is more general and limits the value of language models because they can be hacked for other purposes. A good example that's been going around is having an agential model that manages you emails. Someone sends you an email using prompt injection to compel the agent to delete all your emails. Or forward all you emails to another address. If there isn't a way to secure the behaviour of AI models against reliable exploits then the utility of the models is dramatically limited.