3 ms·It's because of the bigger VRAM - 70B parameters don't fit into the 4090's 24GB.by jhoho 2y agoIt's because of the bigger VRAM - 70B parameters don't fit into the 4090's 24GB.