I think there is a theoretical threat for models hosted on an external server. You could ask a question on lmsys, check your server logs for the generated resp

I think there is a theoretical threat for models hosted on an external server. You could ask a question on lmsys, check your server logs for the generated response, go back to lmsys and pick the response that your model generated. Maybe you could also use a better model for requests from lmsys. E. g. use an unquantized model, disable censorship, etc. I doubt any of the big players are doing that, but you never know.