But crucially not biased by RLHF being applied afterwards to stop the models from making basic biological observations, telling jokes about left wing politics,

But crucially not biased by RLHF being applied afterwards to stop the models from making basic biological observations, telling jokes about left wing politics, or saying anything nonnegative about European historical impact on the world, and so on.