3 ms·
Is it a clear improvement? I run every query through Claude 3, GPT-4, and Gemini Advanced just to compare results. Claude 3 and GPT-4 seem roughly on par with
by CSMastermind 3y ago
Is it a clear improvement?
I run every query through Claude 3, GPT-4, and Gemini Advanced just to compare results.
Claude 3 and GPT-4 seem roughly on par with each other while Gemini is very clearly inferior.
I've run 47 queries in the last month. I marked Claude as doing better than GPT-4 on 2 of those and worse on 3 with the rest being roughly equal.
I wouldn't say it's a clear improvement so much as its an on par competitor.
- stavros 3y agoWhich Claude 3 version is this?
- CSMastermind 3y agoOpus
- nycdatasci 3y agoOpus.
- whiplash451 3y agoJust curious: do you also benchmark Mistral?
- CSMastermind 3y agoNo though if there's an easy way for me to do it I'd add it to the list. Is someone offering a web interface?