4 ms·

we encountered that issue and fixed it + a separate sse event type to signal start/end of summarization for ui/ux. we also build a lot on top of it like more a

by zc2610 6mo ago

we encountered that issue and fixed it + a separate sse event type to signal start/end of summarization for ui/ux. we also build a lot on top of it like more accurate token estimation, customized offloading mechanism etc.

eitanlebras 6mo ago
Oh nice, that separate SSE event seems like a big improvement for UX.