Slight tangent: does anybody know how these models are tuned to censor certain topics so precisely? I thought it was a bit of a black box how things worked int

Slight tangent: does anybody know how these models are tuned to censor certain topics so precisely? I thought it was a bit of a black box how things worked internally?