4 ms·Really takes that much vram??by arpowers 4y agoReally takes that much vram??ioedward 4y agoNormally people split up the model across multiple GPUs, i.e. model/tensor parallelism.