4 ms·
Until they've undergone preference tuning and RL post-training (which is expected to start using more training compute than next-token-prediction pre-training).
by in-silico 1y ago
Until they've undergone preference tuning and RL post-training (which is expected to start using more training compute than next-token-prediction pre-training).