3 ms·
But this is missing exactly the gap which OP seems to have, which is going from a next token predictor (a language model in the classical sense) to an instructi
by phreeza 7mo ago
But this is missing exactly the gap which OP seems to have, which is going from a next token predictor (a language model in the classical sense) to an instruction finetuned, RLHF-ed and "harnessed" tool?
- js8 7mo agoThe book has a sequel https://www.manning.com/books/build-a-reasoning-model-from-scratch https://www.manning.com/books/build-a-reasoning-model-from-s... It will give you an answer to the extent anybody can.