4 ms·Sophia: A Scalable Stochastic Optimizer for Language Model Pre-Training5 points by programd 3y ago