Honest tangent that I'm dying to find an answer for. Is the assumption of truthful prompts something openAI decided should be there, or is the assumption someth

Honest tangent that I'm dying to find an answer for. Is the assumption of truthful prompts something openAI decided should be there, or is the assumption something very deeply baked into this sort of language model? Could they make an argumentative, opinionated, arrogant asshole version of chatGPT if they simply let it off its leash?