3 ms·
24GB VRAM. Using multiple ones scales well because models can be split by layers, and run in a pipelined fashion.
by manmal 2y ago
24GB VRAM. Using multiple ones scales well because models can be split by layers, and run in a pipelined fashion.