3 ms·
GPT-3 was prior to ChatGPT. Since it was a non-instruction tuned model, the output was quite bad unless prompted precisely.
by ipsum2 3y ago
GPT-3 was prior to ChatGPT. Since it was a non-instruction tuned model, the output was quite bad unless prompted precisely.
- danielbln 3y agoGPT-3 was instruct finetuned a while before ChatGPT was even released (see InstructGPT paper and announcement). What ChatGPT went through is RLHF to align its responses to a more conversational level, but you could give GPT-3 (davinci) instructions long before ChatGPT.