3 ms·Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging2 points by PaulHoule 2y ago