4 ms·
That's usually not the case for thinking models. And usually hard problems have a very short prompt.
by redox99 1y ago
That's usually not the case for thinking models. And usually hard problems have a very short prompt.
- danenania 1y agoFor me personally (using mostly for coding and project planning) it's nearly always the case, including with thinking models. I'm usually pasting in a bunch of files, screenshots, etc., and having long conversations. Input nearly always heavily dominates output. I don't disagree that there are hard problems which use short prompts, like math homework problems etc., but they mostly aren't what I would categorize as "real work". But of course I can only speak to my own experience /shrug.
- redox99 1y agoYeah coding is definitely a situation where context is usually very very large. But at the same time in those situations something like Sonnet is fine.