4 ms·
I wonder if you could create an AI bot that interacts in the arena, and knows the telltale signs of a particular LLM, and when it sees that LLM answer, always v
by scrollop 2y ago
I wonder if you could create an AI bot that interacts in the arena, and knows the telltale signs of a particular LLM, and when it sees that LLM answer, always votes for it.
IF it does this hundreds of time, it could alter the results.
Do AI companies care enough to do this vs the risks of discovery? Might be a fun project, and I can imagine that the people who make the decisions on which AI to use for their project/company, may look at this leaderboard.
- minimaxir 2y agoThat's why the sample size is important, since a large sample size would offset a single bad actor. LMSys does have some anti-bot measures (e.g. Cloudflare) which makes it infeasible to manipulate the leaderboard for marketing.
- Tiberium 2y agoLMSys' Cloudflare protection is sadly trivial to bypass - just search for "LMSYS Chatbot Arena: Benchmarking LLMs in the Wild" (with quotes) in Censys and you'll find the origin host. It's a common misconfiguration for services that use Cloudflare as a proxy but then forget to actually make the origin server only respond to requests originating from CF IPs. Although I don't know if anyone's actually botting it.
- huevosabio 2y agoIt wouldn't be hard to do a basic version either. Just check run the output of both outputs through the model and pick the one with highest likelihood according to the model you are trying to promote (since arguably you're trying to promote a model you have access to).