2 ms·
What I find weird is that it generates well structured, well commented code. Where is this massive repository of well structured code with good clear variable
by jameshart 4y ago
What I find weird is that it generates well structured, well commented code.
Where is this massive repository of well structured code with good clear variable names that it’s tapping into?
- clolege 4y agoRight. It must be weighting repos with more stars more heavily in this case, right?
- visarga 4y agoYou could see it as factorised skill learning. In one place it learns how to do some task, in another place it learns how to write nice code, then does both at the same time. It learns all the possible code styles and purposefully uses a good style because it has been taught to choose so - with reinforcement learning from human preferences.
- int_19h 4y agoMaybe it just read all the StackOverflow comments about using clear, expressive names as identifiers, and then unlike most humans, it actually took them seriously? ~