6 ms·
Testing ability of GPT4 and open-source LLMs to detect C++ bugs
- Bostonian 4y ago"open-source" is the key phrase here -- the author finds that GPT 4 can detect C++ bugs: "GPT 4: 0 false alarms in 15 good examples. Detects 13 of 13 bugs."
- chenzhekl 4y agoIt is amazing to see how GPT is so much better than other LLMs. Should this be attributed to OpenAI's better training data?
- fhd2 4y agoPresumably. Vicuna was fine-tuned on ChatGPT responses, but from a quick glance through the examples in the blog post, there are none asking it to find a bug: https://vicuna.lmsys.org/ https://vicuna.lmsys.org/ I've found Vicuna 13B to be quite capable at _generating_ code. But not as good as GPT-4. Model size probably also plays a large role: 13B parameters runs nicely on normal-ish home user hardware, GPT-4 not quite.
- brucethemoose2 4y agoIts possible that LLaMA 65B would be stronger with some instruction tuning, but it looks like its only been done on smaller LLaMa models.
- nullsense 4y agoI really want to see an instruction tuned LLaMA 65B. Hope it will happen.
- davidjones332 4y ago[flagged]
- m1el 4y agoI don't understand how the author can write "No, they cannot.", while the page says "GPT 4: 0 false alarms in 15 good examples. Detects 13 of 13 bugs." Edit: the post says open-source models.
- ssgh 4y agoTested on toy examples: fibonacci numbers, quick sort and so on. Give it a pile of some C++ mess from any well known project.
- qsort 4y agoRegardless of the current SOTA, this is a task where I'm fairly confident future LLMs can get very good at, unlike the "code in natural language" nonsense. I'm thinking something like a linter with access to the AST, that can produce warnings like "you forgot this corner case", "you are not freeing resources. Is this intended?" and so on.
- Groxx 4y agoProbabilistic linters does seem like a fruitful realm for them, yeah. A lot of code shares strong similarities with others in small scales, thanks to stack overflow and various other "help me solve X" -> "try Y" answer pairs. I do wonder how to reliably tell it to ignore noisy, incorrect warnings though. They're potentially sensitive to any new input / weight / random-seed changes, so it seems like literally every LLM upgrade will run the risk of ignoring existing suppressions (or you say "ignore this whole line" and miss useful warnings) due to small perturbations...
- nl 4y agoDidn't test SantaCoder or the salesforce models. Would be interesting to see how they do.
- seydor 4y agoImagine if these were fully open source LLMs. None of them are Then you could fix them I don't get those 'Open source not good enough' posts. However good openAI can get, their secret sauce is known and open source will get there even with a delay. The don't have an exclusivity to the data on the internet
- Groxx 4y agoHow would you fix them in an LLM? You can provide additional examples of these specific issues, sure... but that doesn't mean it'll catch ones you haven't provided. It's not reasoning about what makes the patterns dangerous.
- ChatGTP 4y agoWe’d need to know know Open AI does that, maybe they do indeed reach out to different models for coding ?
- BoorishBears 4y agoFew short learning + chain of thought would let it identify patterns in its gaps
- nl 4y agoThere are fully open source LLMs. For example GPT4All GPT-J edition, Bloom, and there are bunch of code specific ones as well.
- nuand 4y agoI just ran these past OpenAssistant and I'm seeing a much higher error detection rate. I've tried 6 so far, and it's caught bugs in about 4. OpenAssistant actually had a very good technical explanation of the bug it found in the BubbleSort example.
- IYasha 4y ago> The answer may surprise you. May. This is by far two most hilarious bytes I ever heard! :D :D :D
- IYasha 4y agoreturn (c_plus_plus->is(FREAKIN_HARD) || GPT->is(FREAKIN_LAME));// non-mutually-exclusive