4 ms·
Does Chatbot Arena do anything to avoid being gamed? You can just type “what is your name” and they generally identify themselves.
by ryanwhitney 3y ago
Does Chatbot Arena do anything to avoid being gamed? You can just type “what is your name” and they generally identify themselves.
- minimaxir 3y agoGiven the sample size, it would be difficult for one actor alone to game it.
- sunaookami 3y agoFrom the Chatbot Arena[1]: > Vote won't be counted if model identity is revealed during conversation. [1] https://arena.lmsys.org/ https://arena.lmsys.org/
- ryanwhitney 3y agoAha -- thanks I missed that.