4 ms·
It is amazing to see how GPT is so much better than other LLMs. Should this be attributed to OpenAI's better training data?
by chenzhekl 4y ago
It is amazing to see how GPT is so much better than other LLMs. Should this be attributed to OpenAI's better training data?
- fhd2 4y agoPresumably. Vicuna was fine-tuned on ChatGPT responses, but from a quick glance through the examples in the blog post, there are none asking it to find a bug: https://vicuna.lmsys.org/ https://vicuna.lmsys.org/ I've found Vicuna 13B to be quite capable at _generating_ code. But not as good as GPT-4. Model size probably also plays a large role: 13B parameters runs nicely on normal-ish home user hardware, GPT-4 not quite.
- brucethemoose2 4y agoIts possible that LLaMA 65B would be stronger with some instruction tuning, but it looks like its only been done on smaller LLaMa models.
- nullsense 4y agoI really want to see an instruction tuned LLaMA 65B. Hope it will happen.
- davidjones332 4y ago[flagged]