4 ms·
Holy crap, ChatGPT 3.5 fared terribly on that one. I'm usually negative to these kinds of tests and rather rely on the blind test at the leaderboard on Hugging
by jug 3y ago
Holy crap, ChatGPT 3.5 fared terribly on that one. I'm usually negative to these kinds of tests and rather rely on the blind test at the leaderboard on Hugging Face, but this one was special in the unique results that still makes "sense".
It looks kind of like a particularly punishing test but one that still adheres to the trend and LLM advances, so it's not completely BS either.
I actually agree on the test regarding the free Bing Copilot in Creative Mode vs Gemini Pro 1.0 (or called "Gemini (normal)" here). Copilot has been my favorite free way of getting near-GPT4 quality. It's clearly been better at coding for me than Gemini. I think these tables will turn soon though, with the coming public launch of Gemini Pro 1.5.