9 ms·
One thing that is often overlooked in the discussionis that GPT is just extracting the information from sites like stackoverflow and such and distills its knowl
by fxj 3y ago
One thing that is often overlooked in the discussionis that GPT is just extracting the information from sites like stackoverflow and such and distills its knowledge to write new code. But what happens if the main source of coding knowledge - stack overflow etc - suddenly falls dry? No new information for GPT. We all know that unmaintained code starts rotting and this is what will happen to the GPT generated code. GPT needs the fresh blood of human devs to do its job. And this is even more true for new languages and toolkits. First the tutorials and docs have to be written in order for GPT to learn the new code.
- jallen_dot_dev 3y agoIt can learn from it's own users. People paste their code into GPT for context, so it'll see new patterns that way. People paste the error message that results from some bad code GPT spit out, it learns from context plus the error text what the correct code should be.
- fxj 3y agoyes, but it also sees a lot of buggy code this way, because users are no longer experts and write lots of buggy code. Remember, GPT cannot decide whether code is correct or not, it is just a parrot that tells you the code that it sees most often. Try to ask it about some esotheric language like supercollider or J. It will just hallucinate some code that it thinks looks like the one you want. GPT need a certain critical mass of information to give reliable results.