4 ms·
I've tried all the top models. GPT4 beats everything I've tried, including Gemini 1.5- until today. I use GPT4 daily on a variety of things. Claude 3 Opus (be
by jasonjmcghee 3y ago
I've tried all the top models. GPT4 beats everything I've tried, including Gemini 1.5- until today.
I use GPT4 daily on a variety of things.
Claude 3 Opus (been using temperature 0.7) is cleaning up. I'm very impressed.
- thenaturalist 3y agoDo you have specific examples? Otherwise your comment is not quite useful or interesting to most readers as there is no data.
- jasonjmcghee 3y agohttps://gist.github.com/jasonjmcghee/340b7d4cd4260a61438f32c6d5b87cbf https://gist.github.com/jasonjmcghee/340b7d4cd4260a61438f32c...
- thenaturalist 3y agoThank you for sharing!
- ActVen 3y agoSame here. Opus just crushed Gemini Pro and GPT4 on a pretty complex question I have asked all of them, including Claude 2. It involved taking a 43 page life insurance investment pdf and identifying various figures in it. No other model has gotten close. Except for Claude 3 sonnet, which just missed one question.
- jasonjmcghee 3y agoFollow-up: I've continued to test. Definitely wouldn't call it a step function, but love that it's genuinely competitive with GPT4, and often beating it. I am starting to see some cracks- It's struggling with more hardcore / low-level programming tasks, but dealing well with complexity / nested abstraction with proper prompting. It sounds much less AI-y when it talks, like better variation / cadence which I think was what sold me so hard at first.