3 ms·
I would think the difference would be from the data input pipeline, efficiency in batching, updating online models. The inference itself would be the exact same
by crucialfelix 8y ago
I would think the difference would be from the data input pipeline, efficiency in batching, updating online models. The inference itself would be the exact same.