5 ms·
gpt2-chatbot is not the only "mystery model" on LMSYS. Another is "deluxe-chat". When asked about it in October last year, LMSYS replied [0] "It is an experime
by skissane 3y ago
gpt2-chatbot is not the only "mystery model" on LMSYS. Another is "deluxe-chat".
When asked about it in October last year, LMSYS replied [0] "It is an experiment we are running currently. More details will be revealed later"
One distinguishing feature of "deluxe-chat": although it gives high quality answers, it is very slow, so slow that the arena displays a warning whenever it is chosen as one of the competitors
[0] https://github.com/lm-sys/FastChat/issues/2527 https://github.com/lm-sys/FastChat/issues/2527
- concurrentsquar 3y ago> One distinguishing feature of "deluxe-chat": although it gives high quality answers, it is very slow, so slow that the arena displays a warning whenever it is chosen as one of the competitors Beam search or weird attention/non-transformer architecture?
- pennomi 3y agoIt has a room full of scientists typing out the answers by hand.
- Mkengine 3y agoI looked 3 times through the list, I can't find a "deluxe-chat" there, how do I select it?
- skissane 3y agoIt has only ever been available in battle mode. If you do the battle enough you will probably get it eventually. I believe it is still there but doesn’t come up often, it used to be more frequent. (Battle mode is not uniformly random, some models are weighted to compete more often than others.)