3 ms·
Though GPT-3.5 was available a few months before ChatGPT came out (code-davinci-002 was the GPT-3.5 base model, text-davinci-003 had some instruction tuning and
by cubefox 3y ago
Though GPT-3.5 was available a few months before ChatGPT came out (code-davinci-002 was the GPT-3.5 base model, text-davinci-003 had some instruction tuning and RLHF applied). But somehow almost nobody noticed the steep increase in capabilities compared to GPT-3 (davinci).
- nerdponx 3y agoThat "some" RLHF is part of what made such a big difference.
- cubefox 3y agoBut text-davinci-003 was available before ChatGPT.
- redox99 3y agotext-davinci-003 was awful compared to the ChatGPT model. You can try right now text-davinci-003 and gpt-3.5-turbo-instruct and the difference is monumental.
- cubefox 3y agoBut you can't try code-davinci-002 right now, which could do things ChatGPT-3.5 (probably even 4) couldn't do. https://nostalgebraist.tumblr.com/post/706441900479152128/novel-writing-chatgpt-vs-code-davinci-002 https://nostalgebraist.tumblr.com/post/706441900479152128/no... OpenAI removed the model from the API, apparently because it was too powerful.