4 ms·
Why can't you ask both questions (on a variety of topics etc), and grade the answers vs an ideal answer? Ends before means. If 4o answered better than o3, wou
by scrollop 2y ago
Why can't you ask both questions (on a variety of topics etc), and grade the answers vs an ideal answer?
Ends before means.
If 4o answered better than o3, would you still use 03 for your task just because you were told it can "reason"?
- koakuma-chan 2y agoThe point is that you cannot make a general statement that “o1 is better than 4o.”
- freehorse 2y agoYes, but because you need to say exactly what one is better than the other for. Not because o1 spends a bunch of tokens for "reasoning" you cannot even see.
- koakuma-chan 2y agoIf you would like to see the CoT process visualized, try the “Improve prompt” feature in Anthropic console. Also check out https://github.com/getAsterisk/deepclaude https://github.com/getAsterisk/deepclaude