6 ms·
No. The method relies heavily on the peculiar fine-tuning of the InstructGPT line of models, which are trained specifically to follow MTurk-style prose instruct
by goodside 4y ago
No. The method relies heavily on the peculiar fine-tuning of the InstructGPT line of models, which are trained specifically to follow MTurk-style prose instructions. I imagine achieving similar results using a non-InstructGPT model would be hard, but I could be wrong.