3 ms·
> GPT-4 had been shown to outperform humans on the coding competition tasks citation?
by ajkjk 4y ago
> GPT-4 had been shown to outperform humans on the coding competition tasks
citation?
- schrodinger 4y ago[flagged]
- lovecg 4y agoI haven’t seen a clear answer on this actually - there was some confusion if the training data contained solutions for older problems, and if it underperforms on previously unseen ones. Plus it still seemed to underperform on medium and hard problems? Does anyone in the know have a summary on this?
- nozzlegear 4y agoSometimes things that have been discussed as possibilities on this forum begin to be repeated and taken as fact. One might say that this forum has hallucinated the capabilities of this bot beyond its actual capacity, and the hallucination grows daily. A citation is indeed needed.
- camdenreslink 4y agoI think it has only been shown that ChatGPT can solve easy/some medium leetcode style questions. I doubt it can solve difficult problems that would give human competitive programmers a hard time (for now anyway...)
- unethical_ban 4y agoGPT4 has been out for what, weeks? We aren't talking established theorems here.
- ajkjk 4y agoOh, I looked and didn't find anything. I thought about writing something about how I thought it wasn't true but decided it would be better to just ask if they had a reference for it. also, it's an extraordinary claim, so pretending like it's something everybody already knows is pretty weird.
- dragonwriter 4y agoProbably like most GPT-4 performance claims, the non-peer-reviewed scientifically-formatted paper with opaque methodology published as PR for GPT-4.