3 ms·Got it, thanks for the information! I hadn't known it was all VRAM for model serving.by metadat 4y agoGot it, thanks for the information! I hadn't known it was all VRAM for model serving.