3 ms·
> as long as it produces the results you expect? But it's more the case of "until it doesn't produce the results you expect" and then what do you do?
by sceptic123 1y ago
> as long as it produces the results you expect?
But it's more the case of "until it doesn't produce the results you expect" and then what do you do?
- diggan 1y ago> "until it doesn't produce the results you expect" and then what do you do? I'm not sure I understand what you mean. You're asking it to do something, and it doesn't do that?
- dingnuts 1y agoif you give an LLM a spec with a new language and no examples, it can't write the new language. until someone does that, I think we've demonstrated that they do not have understanding or abstract thought. they NEED examples in a way humans do not.
- Powdering7082 1y agohttps://openreview.net/pdf?id=GTHD2UnDIb https://openreview.net/pdf?id=GTHD2UnDIb
- mysterydip 1y agoInteresting paper, thanks for sharing. I assume the effectiveness depends greatly on the syntax of the language to be learned (c-like, etc).
- seunosewa 1y agoThen you teach it. Even humans don't always produce the results we expect.
- sceptic123 1y agoHave you tried that? It generally doesn't go so well. In this example there are several commits where you can see they needed to fix the code because they couldn't get (teach) the LLM to generate the required code. And there's no memory there, you open a new prompt and it's forgotten everything you said previously.
- JW_00000 1y agoThen you do that part yourself. You let AI automate the 20/50/80% (*) of work it can, and you now only need to do the remainder manually. (*) which one of these it is depends on your case. If you're writing a run-of-the-mill Next.js app, AI will automate 80%; if you're doing something highly specific, it'll be closer to 20%.