4 ms·
I use L40s because H100s and A100s are backlogged, but for big models the lack of memory capacity and PCIe card-communication bottleneck is a pain, I'm planning
by apsec112 3y ago
I use L40s because H100s and A100s are backlogged, but for big models the lack of memory capacity and PCIe card-communication bottleneck is a pain, I'm planning to switch as soon as there's capacity available