3 ms·
Also, now we're paying for output tokens that aren't even output, with no good explanation for why these tokens should be hidden from the person who paid for th
by lolinder 2y ago
Also, now we're paying for output tokens that aren't even output, with no good explanation for why these tokens should be hidden from the person who paid for them.
- HeatrayEnjoyer 2y agoIf you read the link they have a section specifically explaining why it is hidden.
- lolinder 2y agoI read it. It's a bad explanation. The only bit about it that feels at all truthful is this bit, which is glossed over but likely the only real factor in the decision: > after weighing multiple factors including ... competitive advantage ... we have decided not to show the raw chains of thought to users.
- HeatrayEnjoyer 2y agoBad, in your opinion.
- infogulch 2y agoGood catch. That indicates that chains of thought are a straightforward approach to make LLMs better at reasoning if you could copy it just by seeing the steps.