The examples you have in mind may be totally reasonable - but conflating "factually true" with being somehow unassailable on any other qualities, or being above

The examples you have in mind may be totally reasonable - but conflating "factually true" with being somehow unassailable on any other qualities, or being above reproach and not hateful, is a super common fallacy. E.g. pointing to differences in cranial shape between races is often used, with various levels of implicitness/explicitness, as a way to express race-based hatred.