4 ms·
not necessarily -- CUDA produces many function calls, which in API remoting setups could degrade performance -- in our case, we draw the abstraction line a bit
by ananos 3y ago
not necessarily -- CUDA produces many function calls, which in API remoting setups could degrade performance -- in our case, we draw the abstraction line a bit "higher" in the stack so it's more like a "functional" API remoting -- eg. image classification
- gaocegege 3y agoGotcha, that makes sense.