4 ms·
> HTTP is just not a good transport for streaming LLM tokens and for building async agentic applications I don't know if I agree if this is a problem with SSE
by ekojs 5mo ago
> HTTP is just not a good transport for streaming LLM tokens and for building async agentic applications
I don't know if I agree if this is a problem with SSE or HTTP. Something like a Redis Streams-backed SSE would solve most of the 'challenges' presented in the post.