3 ms·
Chatbot Arena has banned Gpt2-Chatbot by now. It's not entirely clear, the notice says: gpt2-chatbot is currently unavailable. See our model evaluation policy
by isaacfrond 3y ago
Chatbot Arena has banned Gpt2-Chatbot by now. It's not entirely clear, the notice says:
gpt2-chatbot is currently unavailable. See our model evaluation policy here.
It's not clear to me though, which part of the policy they violated though.
- belter 3y agoTried that model, it seemed to have a larger than usual training set, and nice eloquence, but there was nothing revolutionary compared to current state of the art models. Put it through some of the usual tests, and showed same weaknesses of most models. For example given a sequence of eight numeric values: 4, 5, 5, 4 ,2, 3, 4, 4 Ask the model to create a phrase with as many words as the amount of numbers, and where each word will as many characters as the corresponding numeric value. For example: "Four happy ducks swim in the clear pond" Most models will create phrases with more or less words, and the number of characters in each word, will not match the sequence. And so did this mysterious model...So it might be GPT 4.5 but it's probable not GPT-5 :-)
- andy99 3y agoI hadn't understood it was banned, just that the policy explains they do anonymous testing for LLM providers, with the implication that they pulled the model now that the test is done: https://news.ycombinator.com/item?id=40215273 https://news.ycombinator.com/item?id=40215273