2 ms·For now it's for single GPU inference only.by ipiszy 4y agoFor now it's for single GPU inference only.