3 ms·
It is steered by RLHF to give helpful, nice, structured continuations. it was totally trained on random text they never paid a dime for.
by seydor 4y ago
It is steered by RLHF to give helpful, nice, structured continuations. it was totally trained on random text they never paid a dime for.
- EGreg 4y agoCan you please elaborate and answer 1,2,3 directly — I’d love to find out more. Maybw links to the techniques
- seydor 4y agoI am not an expert but as others have said, the InstructGPT and Alpaca models do that https://arxiv.org/abs/2203.02155# https://arxiv.org/abs/2203.02155# https://crfm.stanford.edu/2023/03/13/alpaca.html https://crfm.stanford.edu/2023/03/13/alpaca.html