I wouldn't be surprised if they have another model classifying explicit images in their toolchain and don't even send anything to the actual LLM if it fails the

I wouldn't be surprised if they have another model classifying explicit images in their toolchain and don't even send anything to the actual LLM if it fails the test. In the same way OpenAI's models are thought to do segmentation and OCR as part of the toolchain, making them far better at certain vision tasks than other models. The only ways you can trust a model on lmsys (or any other test), is if it's open weights and you can run the model yourself. And even then you have to use private tests that were never put on the internet or submitted to any AI API if you want results to be reliable and untainted.