13 ms·
Definitely try Claude 3.5 Sonnet and o1-preview. They have succeeded for me where other models have failed. Also, use Cursor IDE.
by nycdatasci 2y ago
Definitely try Claude 3.5 Sonnet and o1-preview. They have succeeded for me where other models have failed. Also, use Cursor IDE.
- cft 2y agoo1-mini is even higher in coding benchmarks than o1-preview. That has been my experience also.
- mlhpdx 2y agoOh, I’ve found Claude 3.5 to be better but still pointless. To be specific, it generates code that does what I ask (roughly) but… - Has obvious bugs, many at runtime - Has subtle bugs. - Is inefficient. All of which it will generally fix when asked. But how useful is it if I need to know all the problems with its code beforehand? Then it responds with the same-ish wrong answer the next time. Still a long way to go IMO.
- csomar 2y agoClaude 3.5 is good, however, it's "Type comprehension" is really basic. That was my experience with it when using Rust. It still can't create an internal mental model of the types and how to link them together. It'll also, at some points, start to heavily hallucinate functions and stuff.