4 ms·
"open-source" is the key phrase here -- the author finds that GPT 4 can detect C++ bugs: "GPT 4: 0 false alarms in 15 good examples. Detects 13 of 13 bugs."
by Bostonian 4y ago
"open-source" is the key phrase here -- the author finds that GPT 4 can detect C++ bugs:
"GPT 4: 0 false alarms in 15 good examples. Detects 13 of 13 bugs."
- chenzhekl 4y agoIt is amazing to see how GPT is so much better than other LLMs. Should this be attributed to OpenAI's better training data?
- fhd2 4y agoPresumably. Vicuna was fine-tuned on ChatGPT responses, but from a quick glance through the examples in the blog post, there are none asking it to find a bug: https://vicuna.lmsys.org/ https://vicuna.lmsys.org/ I've found Vicuna 13B to be quite capable at _generating_ code. But not as good as GPT-4. Model size probably also plays a large role: 13B parameters runs nicely on normal-ish home user hardware, GPT-4 not quite.
- brucethemoose2 4y agoIts possible that LLaMA 65B would be stronger with some instruction tuning, but it looks like its only been done on smaller LLaMa models.
- nullsense 4y agoI really want to see an instruction tuned LLaMA 65B. Hope it will happen.
- davidjones332 4y ago[flagged]