3 ms·
Note that Alpaca is NOT using RLHF. It explicitly states it used supervised finetuning.
by sanxiyn 4y ago
Note that Alpaca is NOT using RLHF. It explicitly states it used supervised finetuning.
- est 4y agoIt says > We train the Alpaca model on 52K instruction-following demonstrations generated in the style of self-instruct using text-davinci-003 Which leads to self-instruct https://github.com/yizhongw/self-instruct https://github.com/yizhongw/self-instruct From a glimpse they used a LM to classify instructions & train the model which IMHO is very similar to RLHF
- sanxiyn 4y agoNo, it is not RLHF because there is no reward model involved. See also OpenAI's explanation here: https://platform.openai.com/docs/model-index-for-researchers https://platform.openai.com/docs/model-index-for-researchers