2 ms·
So won’t that make the network the prohibitive bottle neck? Your memory bandwidth is 1gbps max
by m3kw9 2y ago
So won’t that make the network the prohibitive bottle neck? Your memory bandwidth is 1gbps max
- teaearlgraycold 2y agoCloud hosts will offer 10Gb/s. Anyway, in my experience with training LoRAs and running DINOv2 inference you don’t need much bandwidth. We are usually sitting at around 10-30MB/s per GPU.