3 ms·Sophia: Stochastic Second-Order Optimizer for Language Model Pre-Training7 points by alechammond 3y ago