A much better way is to RLHF the LLM until you get the behavior you want. As far as I know, modern LLMs try to strike a balance between being somewhat neutral,

A much better way is to RLHF the LLM until you get the behavior you want. As far as I know, modern LLMs try to strike a balance between being somewhat neutral, while not being too neutral on topics outside of the overton window. They'll give you a "both sides have their good points" argument on abortion, religion, guns or immigration, but won't do that for obvious racism or nazi viewpoints. Early LLMs had a problem with getting this balance right, I feel like many of them were a lot more left-leaning. I don't know how much of the change is caused by us understanding the technology better and how much is just the political winds shifting, though. I felt like we had a moment there when some models were a bit too "well it depends", even on very uncontroversial subjects.