4 ms·
I can't think of any case where inference doesn't care about latency.
by jeffbee 11mo ago
I can't think of any case where inference doesn't care about latency.
- cyanydeez 11mo agoI cant thinl of any reason training isnt going to become real time with a significant cpu budget.