3 ms·
Instruction-tuning isn't typically considered a guard rail. Raw pretrained LLMs are close to useless, since they just predict text. Guard-rails are when you tra
by sterlind 3y ago
Instruction-tuning isn't typically considered a guard rail. Raw pretrained LLMs are close to useless, since they just predict text. Guard-rails are when you train the AI not to obey certain instructions.
- dbmikus 3y agoGood point about the negative reinforcement training! Instruction tuning is on top of the base LLM and is often RLHF to train the base LLM to produce certain kinds of responses.