4 ms·
"Just" is the wrong way to put it. Pretraining teaches LLMs everything. SFT and RL is about putting that "everything" into useful configurations and gluing it
by ACCount37 1y ago
"Just" is the wrong way to put it.
Pretraining teaches LLMs everything. SFT and RL is about putting that "everything" into useful configurations and gluing it together so that it works better.