2 ms·
’’’Phrases like “think”, “think hard”, “ultrathink”, and “think more” are interpreted as regular prompt instructions and don’t allocate thinking tokens.’’’
by Computer0 8mo ago
’’’Phrases like “think”, “think hard”, “ultrathink”, and “think more” are interpreted as regular prompt instructions and don’t allocate thinking tokens.’’’
- deleted 8mo ago[deleted]
- prodigycorp 8mo agoThey dont allocate thinking tokens but they do change model behavior.
- Computer0 8mo agoI was getting this in my Claude code app, it seems clear to me that they didn’t want users to do that anymore and it was deprecated. https://i.redd.it/jvemmk1wdndg1.jpeg https://i.redd.it/jvemmk1wdndg1.jpeg
- prodigycorp 8mo agoThx for the correction. Changed a couple weeks ago. https://decodeclaude.com/ultrathink-deprecated/ https://decodeclaude.com/ultrathink-deprecated/
- sunaookami 8mo agoNice blog, this post is interesting: https://decodeclaude.com/compaction-deep-dive/ https://decodeclaude.com/compaction-deep-dive/ Didn't know about Microcompaction!
- prodigycorp 8mo agoIf you're a big context/compaction fan and want another fun fact, did you know that instead of doing regular compaction (prompting the agent to summarize the conversation in a particular way and starting the new conversation with that), Codex passes around a compressed, encrypted object that supposedly preserves the latent space of the previous conversation in the new conversation. https://openai.com/index/unrolling-the-codex-agent-loop/ https://openai.com/index/unrolling-the-codex-agent-loop/ https://platform.openai.com/docs/guides/conversation-state#compaction-advanced https://platform.openai.com/docs/guides/conversation-state#c... Context management is the new frontier for these labs.