4 ms·
Headroom looks great for client-side trimming. If you want to tackle this at the infrastructure level, we built Edgee (https://www.edgee.ai https://www.edgee.ai
by kokakiwi 6mo ago
Headroom looks great for client-side trimming. If you want to tackle this at the infrastructure level, we built Edgee (https://www.edgee.ai https://www.edgee.ai) as an AI Gateway that handles context compression, caching, and token budgeting across requests, so you're not relying on each client to do the right thing.
(I work at Edgee, so biased, but happy to answer questions.)
- gilles_oponono 6mo ago100% agree
- anandvshah 6mo agoI have used Edgee.AI and it is amazing.