The first-order problem is important...how do we make sure that we can rely on LLM's to not spit out violent stuff. This matters to Anthropic & Friends to make

The first-order problem is important...how do we make sure that we can rely on LLM's to not spit out violent stuff. This matters to Anthropic & Friends to make sure they can sell their magic to the enterprise. But the social problem we all have is different... What happens when a human with negative intentions builds an attacking LLM? There are groups already working on it. What should we expect? How do we prepare?