2 ms·
i want 5.4 nano to decide whether my prompt needs 5.4 xhigh and route to it automatically
by dack 8mo ago
i want 5.4 nano to decide whether my prompt needs 5.4 xhigh and route to it automatically
- exitb 8mo agoLike any work estimation, it will likely disappoint.
- mrtesthah 8mo agoAs per OpenAI themselves, xhigh is only necessary if the agent gets stuck on a long running task. Otherwise it’s thinking trades use so many tokens of context that it’s less effective than high for a great majority of tasks. This has also been my experience.
- dack 8mo agoyes but didn't greg brockman say he just runs on xhigh at all times?