2 ms·
Token Arbitrage: Use Sol for coding, Luna for compaction, save 84%
- Leynos 2mo agoIs this using the server side compaction of the responses API?
- GodelNumbering 2mo agoNo, server-side compaction is inherently tied to the model's current context. This uses a full side prompt to get the compaction result, then swap the context with new compaction result. I did a bunch of tests and the results from Luna were indistinguishable from Sol