3 ms·

“Reflection-Based GPT-4 Agent is State-of-the-Art on Code Gen Iteratively refines code, shifting “accuracy bottleneck” from correct code gen to correct test ge

“Reflection-Based GPT-4 Agent is State-of-the-Art on Code Gen Iteratively refines code, shifting “accuracy bottleneck” from correct code gen to correct test gen HumanEval accuracy: -Reflexion-based GPT-4 88% -GPT-4 67.0% -CodeT 65.8% -PaLM 26.2%” with link to code in the Tweet: https://mobile.twitter.com/johnjnay/status/1639362071807549446 https://mobile.twitter.com/johnjnay/status/16393620718075494... 21% improvement after adding a feedback loop and self-reflection to GPT-4, which just went public 12 days ago. (The approach is based on a preprint published 4 days ago.) Human coders often need a feedback loop and self-reflection to properly “generate” code for problems novel to them as well. ----- A larger question: Are we hurling ourselves toward a (near) future of unaligned AGI with self-improvement capabilities?

deleted 4y ago
[deleted]
riku_iki 4y ago
so how do we know chat gpt didn't have humaneval in training data?
- nopinsight 4y ago
  The point is adding a couple components can improve GPT-4 significantly, as shown above. The data it originally trained with is presumably held constant in the evaluation above.
  - riku_iki 4y ago
    the point is if humaneval was in gpt training data, then this component improved memorization from mediocre to Ok-ish, and actual coding skills still not tested.
    - nopinsight 4y ago
      From other people’s and my experiences, GPT-4 can do more than simply memorizing. It can at least interpolate and reason a little bit too. A few other tests show that GPT-4 would achieve much better results than 67% for something it has sufficient training data on like GRE Verbal and AP Macroeconomics. https://openai.com/research/gpt-4 https://openai.com/research/gpt-4 Yes, it still can’t generalize properly outside its training distribution. However, when armed with feedback and self-reflection, it seems better at that too.
      - hughesjj 4y ago
        yup. we're (we=the public) far from getting access to the full model. that said one of the commentors in the twitter thread brings up how openapi isnt being fully forthcoming about their methods. AI Explained has a good summary of many of these topics
isaacfrond 4y ago
the paper: https://arxiv.org/pdf/2303.11366.pdf https://arxiv.org/pdf/2303.11366.pdf it reminds me of the thinking-fast vs. thinking-slow dichotomy. Current llms are the thinking fast type. Funnily people’s complains about its errors are reminiscent of this. It answers just to quick and only with its instant response neural net. A thinking slow answer would be more akin to a chain of thought answer. Allowing the llm a more flexible platform than CoT promptin might well be the next step. Of course it would als multiply compute cost. So it might not be in your 20$ subscription
nopinsight 4y ago
Someone asked GPT-4 to build a complete app from scratch. It's now on the store. He seems to apply good prompt engineering techniques. Screenshots, video demo, and process here: https://mobile.twitter.com/mortenjust/status/1639276571574894594 https://mobile.twitter.com/mortenjust/status/163927657157489... It seems plausible to me now that a junior developer position would be hard to find in 2-3 years (I thought it would be ~5 years).
- mrbombastic 4y ago
  So this is very impressive and looks like a solid lowering of barrier to entry which is great….but that app is around 300 lines of code in one file that fetches data on 5 movies, screenshots are not cropped correctly and the pager doesn’t swipe back to the first dot. I am bit surprised it made it through the review process. Not hating I think it is great to make this stuff more approachable but not convinced junior devs are in danger yet.
  - nopinsight 4y ago
    GPT-3 was released less than 3 years ago and it was far from capable of this.
    - mrbombastic 4y ago
      Sure and it is impressive but the upper bounds of AI products are hard to predict. That said things are changing fast I don’t know what tomorrow will bring.
    - mjburgess 4y ago
      Exponential curves are theoretical constructs: all actual phenomena are S-shaped. The question is only when does the "exponential regime" turn into the flat; and the answer is often fairly obvious if you don't begin from the "time = magic" premise. There's an entire industry of public (pseudo)-intellectual who's schtick is to draw logistic phenomena with exponential curves and then cry, "the sky is falling!".
PartiallyTyped 4y ago
> A larger question: Are we hurling ourselves toward a (near) future of unaligned AGI with self-improvement capabilities? We are running towards a brick wall and people are not paying attention. Setting up self-reflection loops today is actually fairly trivial and can be done programmatically, all the model needs is to produce a solution, invoke the evaluation and keep iterating.
cornholio 4y ago
A narrower question: can we perhaps stop putting AGI and ChatGPT in the same paragraphs as if they are somehow relevant to each other? Intelligence has very little to do with a glorified Google search trained by statistical crunching of superhuman amounts of data; there is not even a chicken-sized trace of intelligence in ChatGPT that is not a reflection of the training set or of the embedded human-designed models it uses to mimicry problem solving and conversation.
- nopinsight 4y ago
  Several necessary ingredients of human intelligence are present in GPT-4: complex pattern matching, abstraction from concrete examples and apply the abstract patterns to new examples, pattern interpolation, basic reasoning. This is evident by its ability to generalize from the training set to new problems within many domains. It's still unable to generalize as well as a smart human beyond the distribution it was specifically trained on, which is evident by its poor performance on AMC, Leetcode medium and hard, and Codeforces problems. But most humans are not great at these kinds of problems either. Benchmark and test results: https://openai.com/research/gpt-4 https://openai.com/research/gpt-4

deleted 4y ago

[deleted]

riku_iki 4y ago

so how do we know chat gpt didn't have humaneval in training data?

nopinsight 4y ago
The point is adding a couple components can improve GPT-4 significantly, as shown above. The data it originally trained with is presumably held constant in the evaluation above.
- riku_iki 4y ago
  the point is if humaneval was in gpt training data, then this component improved memorization from mediocre to Ok-ish, and actual coding skills still not tested.
  - nopinsight 4y ago
    From other people’s and my experiences, GPT-4 can do more than simply memorizing. It can at least interpolate and reason a little bit too. A few other tests show that GPT-4 would achieve much better results than 67% for something it has sufficient training data on like GRE Verbal and AP Macroeconomics. https://openai.com/research/gpt-4 https://openai.com/research/gpt-4 Yes, it still can’t generalize properly outside its training distribution. However, when armed with feedback and self-reflection, it seems better at that too.
    - hughesjj 4y ago
      yup. we're (we=the public) far from getting access to the full model. that said one of the commentors in the twitter thread brings up how openapi isnt being fully forthcoming about their methods. AI Explained has a good summary of many of these topics

isaacfrond 4y ago

the paper: https://arxiv.org/pdf/2303.11366.pdf https://arxiv.org/pdf/2303.11366.pdf it reminds me of the thinking-fast vs. thinking-slow dichotomy. Current llms are the thinking fast type. Funnily people’s complains about its errors are reminiscent of this. It answers just to quick and only with its instant response neural net. A thinking slow answer would be more akin to a chain of thought answer. Allowing the llm a more flexible platform than CoT promptin might well be the next step. Of course it would als multiply compute cost. So it might not be in your 20$ subscription

nopinsight 4y ago

Someone asked GPT-4 to build a complete app from scratch. It's now on the store. He seems to apply good prompt engineering techniques. Screenshots, video demo, and process here: https://mobile.twitter.com/mortenjust/status/1639276571574894594 https://mobile.twitter.com/mortenjust/status/163927657157489... It seems plausible to me now that a junior developer position would be hard to find in 2-3 years (I thought it would be ~5 years).

mrbombastic 4y ago
So this is very impressive and looks like a solid lowering of barrier to entry which is great….but that app is around 300 lines of code in one file that fetches data on 5 movies, screenshots are not cropped correctly and the pager doesn’t swipe back to the first dot. I am bit surprised it made it through the review process. Not hating I think it is great to make this stuff more approachable but not convinced junior devs are in danger yet.
- nopinsight 4y ago
  GPT-3 was released less than 3 years ago and it was far from capable of this.
  - mrbombastic 4y ago
    Sure and it is impressive but the upper bounds of AI products are hard to predict. That said things are changing fast I don’t know what tomorrow will bring.
  - mjburgess 4y ago
    Exponential curves are theoretical constructs: all actual phenomena are S-shaped. The question is only when does the "exponential regime" turn into the flat; and the answer is often fairly obvious if you don't begin from the "time = magic" premise. There's an entire industry of public (pseudo)-intellectual who's schtick is to draw logistic phenomena with exponential curves and then cry, "the sky is falling!".

PartiallyTyped 4y ago

> A larger question: Are we hurling ourselves toward a (near) future of unaligned AGI with self-improvement capabilities? We are running towards a brick wall and people are not paying attention. Setting up self-reflection loops today is actually fairly trivial and can be done programmatically, all the model needs is to produce a solution, invoke the evaluation and keep iterating.

cornholio 4y ago

A narrower question: can we perhaps stop putting AGI and ChatGPT in the same paragraphs as if they are somehow relevant to each other? Intelligence has very little to do with a glorified Google search trained by statistical crunching of superhuman amounts of data; there is not even a chicken-sized trace of intelligence in ChatGPT that is not a reflection of the training set or of the embedded human-designed models it uses to mimicry problem solving and conversation.

nopinsight 4y ago
Several necessary ingredients of human intelligence are present in GPT-4: complex pattern matching, abstraction from concrete examples and apply the abstract patterns to new examples, pattern interpolation, basic reasoning. This is evident by its ability to generalize from the training set to new problems within many domains. It's still unable to generalize as well as a smart human beyond the distribution it was specifically trained on, which is evident by its poor performance on AMC, Leetcode medium and hard, and Codeforces problems. But most humans are not great at these kinds of problems either. Benchmark and test results: https://openai.com/research/gpt-4 https://openai.com/research/gpt-4