3 ms·
I don't think it does any other processing honestly, it might have a slight delay added in on each token, but it's pretty close to just streaming the output
by blharr 3y ago
I don't think it does any other processing honestly, it might have a slight delay added in on each token, but it's pretty close to just streaming the output