3 ms·
Funnily enough, I test code generation both on unpaid Claude and ChatGPT. When working with Python, I've found Sonnet (pre 3.5) to be quite superior to ChatGPT
by thenaturalist 2y ago
Funnily enough, I test code generation both on unpaid Claude and ChatGPT.
When working with Python, I've found Sonnet (pre 3.5) to be quite superior to ChatGPT (mostly 4, sometimes 3.5) with regards to verbosity, structure and prompt / instruct comprehension.
I've switched to a JavaScript project two weeks ago and the tables have turned.
Sonnet 3.5 is much more verbose and I need to make corrections a few times, whereas ChatGPTs output is shorter and on point.
I'll closely follow if this improves if Claude are focussing on JS themselves.
- bravura 2y agoDon't call me crazy (I am actually), but sometimes I will keep both ChatGPT and Claude open side-by-side and use them to audit each other. I'll give them the same prompt. When they respond, re-prompt with: "What are your thoughts on this approach? Pros and cons. Integrate the best ideas from both: [answer from the other model]" Repeat until total satisfaction or frustration is achieved.
- emmanueloga_ 2y agoThis is similar to what Aider does in "architect" mode [1]. -- 1: https://aider.chat/docs/usage/modes.html#architect-mode-and-the-editor-model https://aider.chat/docs/usage/modes.html#architect-mode-and-...