I think there is more to it than just batch speed. For real-time processing you can’t look ahead Beyond the current buffer. Basically the question is can the mo

I think there is more to it than just batch speed. For real-time processing you can’t look ahead Beyond the current buffer. Basically the question is can the model be run in a streaming fashion, and is it still fast running that way