4 ms·
I thought the RTX 6000 Ada was 48GB? If you have 96GB available that implies a dual setup, so you must be relying on tensor parallelism to shard the model weigh
by storystarling 8mo ago
I thought the RTX 6000 Ada was 48GB? If you have 96GB available that implies a dual setup, so you must be relying on tensor parallelism to shard the model weights across the pair.
- embedding-shape 8mo agoRTX Pro 6000 - 96GB VRAM - Single card