3 ms·
You gain more benefit spending compute on post-training than on pre-training. But scaling pre-training is still worth it if you can afford it.
by dist-epoch 8mo ago
You gain more benefit spending compute on post-training than on pre-training.
But scaling pre-training is still worth it if you can afford it.