2 ms·
>"Reasoning", however, is a feature that has been bolted on with a hacksaw and duct tape. What do you mean by this? Especially for tasks like coding where ther
by charcircuit 9mo ago
>"Reasoning", however, is a feature that has been bolted on with a hacksaw and duct tape.
What do you mean by this? Especially for tasks like coding where there is a deterministic correct or incorrect signal it should be possible to train.
- direwolf20 9mo agoit's meant in the literal sense but with metaphorical hacksaws and duct tape. Early on, some advanced LLM users noticed they could get better results by forcing insertion of a word like "Wait," or "Hang on," or "Actually," and then running the model for a few more paragraphs. This would increase the chance of a model noticing a mistake it made. Reasoning is basically this.
- charcircuit 9mo agoIt's not just force inserting a word. Reasoning is integrated into the training process of the model.
- samrus 9mo agoNot the core foundation model. The foundation model still only predicts the next token in a static way. The reasoning is tacked onto the instructGPT style finetuning step and its done through prompt engineering. Which is the shittiest way a model like this could have been done, and it shows