2 ms·Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch1 points by rasbt 3y ago