4 ms·
Per LLM leaderboard, Bard (jan 24 - Gemini Pro) is on par with GPT 4: https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard https://huggingface.co/space
by nycdatasci 3y ago
Per LLM leaderboard, Bard (jan 24 - Gemini Pro) is on par with GPT 4:
https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboar...
I think there’s bias in the types of prompts they’re getting. In my personal experience, Bard is useful for creative use cases but not good with reasoning or facts.
- EvgeniyZh 3y agoThey are getting whatever you give them ;)
- skissane 3y agoHere is a simple maths problem that GPT-4 gets right but Bard (even the Gemini Pro version) consistently gets wrong: “What is one (short scale) centillion divided by the cube of a googol?” But you are right, we don’t know the types of prompts Chatbot Arena users are submitting. Maths problems like that are probably a small minority of usage. One other thing I notice: if you ask about controversial issues, both GPT-3.5/4 and Bard can get a bit “preachy” from a progressive perspective - but I personally find Bard to be noticeably more “preachy” than OpenAI at this (while still not reaching Llama levels)