4 ms·Would batch inference increase throughput further? Or does it already peak the FLOPS?by lostmsu 2y agoWould batch inference increase throughput further? Or does it already peak the FLOPS?