3 ms·
The instruction-tuning is the guard rail. What other guard-rails is X AI removing? Just curious if I'm missing something.
by dbmikus 3y ago
The instruction-tuning is the guard rail. What other guard-rails is X AI removing? Just curious if I'm missing something.
- sterlind 3y agoInstruction-tuning isn't typically considered a guard rail. Raw pretrained LLMs are close to useless, since they just predict text. Guard-rails are when you train the AI not to obey certain instructions.
- dbmikus 3y agoGood point about the negative reinforcement training! Instruction tuning is on top of the base LLM and is often RLHF to train the base LLM to produce certain kinds of responses.