The biggest problem with all the Google models has always been RLHF, particularly safety training. They take a good, smart model and make it behave like a corpo

The biggest problem with all the Google models has always been RLHF, particularly safety training. They take a good, smart model and make it behave like a corporate person that has been to far to many forced anti-{sexism, racism...} seminars so that it is now living in fear of saying something that could be construed as wrong by some moral standard.