3 ms·Training Compact Transformers from Scratch in 30 Minutes with PyTorch3 points by godelski 5y ago