3 ms·
Hono still doesn’t support request cancellation well. So if you’re streaming tokens from an LLM and you cancel the request from the client you’ll be wasting mo
by orph 2y ago
Hono still doesn’t support request cancellation well.
So if you’re streaming tokens from an LLM and you cancel the request from the client you’ll be wasting money.