the RLHF has indeed made them quite sycophantic. i don't believe in any of the 'latent space wario' stuff, but i really enjoy using it explicitly to get clarifi

the RLHF has indeed made them quite sycophantic. i don't believe in any of the 'latent space wario' stuff, but i really enjoy using it explicitly to get clarification and explanation from opposing viewpoints. i would love to see some experiment where a debate is held/moderated by an LLM which can help find common ground in highly contentious viewpoints. the post-mortem from each side would be a fascinating read.