3 ms·
Headroom looks great for client-side trimming. If you want to tackle this at the infrastructure level, we built Edgee (https://www.edgee.ai https://www.edgee.ai
by kokakiwi 7mo ago
Headroom looks great for client-side trimming. If you want to tackle this at the infrastructure level, we built Edgee (https://www.edgee.ai https://www.edgee.ai) as an AI Gateway that handles context compression, caching, and token budgeting across requests, so you're not relying on each client to do the right thing.
(I work at Edgee, so biased, but happy to answer questions.)
- gilles_oponono 7mo ago100% agree
- anandvshah 7mo agoI have used Edgee.AI and it is amazing.