3 ms·Sophia: A Scalable Second-Order Optimizer for Language Model Pre-Training4 points by Anon84 6mo ago66y66 6mo agoggtttttttttyy