3 ms·
This beta header hides thinking from the UI, since most people don't look at it. How is this measured?
by thomascountz 6mo ago
This beta header hides thinking from the UI, since most people don't look at it.
How is this measured?
- stingraycharles 6mo agoAnd I wonder how redacting them reduces latency, as it sure as hell doesn’t make the responses any faster and bandwidth isn’t the issue here.
- sothatsit 6mo agoThey provide thinking summaries, so I assume they have to call Haiku or some other model to summarise the thinking blocks.
- stingraycharles 6mo agoThat’s not asynchronous? Wouldn’t it make more sense to disable those thinking summaries in those cases rather than hiding the thinking altogether?