4 ms·
Awesome, can’t wait to try this. I wish the big AI labs would make more frequent model improvements, like on a monthly cadence, as they continue to train and im
by eigenvalue 2y ago
Awesome, can’t wait to try this. I wish the big AI labs would make more frequent model improvements, like on a monthly cadence, as they continue to train and improve stuff. Also seems like a good way to do A/B testing to see which models people prefer in practice.
- Eliezer 2y agoThat's a hard ask given the actual training runs are multi-month, and have distinguished pretraining and refinement phases.
- eigenvalue 2y agoTrue, but they could have multiple parallel running training processes going on at the same time. And they could release models that result from partial training checkpoints if they can quantify that they are better than the last released model and also "safe."