4 ms·
Really high potential service to reduce OPEX of AI services and increase the context window! And really straightforward to test it.
by kostas77 7mo ago
Really high potential service to reduce OPEX of AI services and increase the context window! And really straightforward to test it.
- gskm 7mo agoThank you! That's exactly the goal, drop-in token savings without changing your LLM pipeline. If you give it a spin, I'd love to hear how it works on your data. We're actively tuning the ranking based on early feedback, so any input helps shape the product.