7 ms·
"pretty decent english" is a pretty fuzzy bar. Indeed, Chat GPT 4 and Copilot can generate "pretty decent code" that will look fine to the average human coder
by majormajor 3y ago
"pretty decent english" is a pretty fuzzy bar.
Indeed, Chat GPT 4 and Copilot can generate "pretty decent code" that will look fine to the average human coder even when it's incorrect (making up methods or getting params wrong or slighly missing requirements or similar).
The level of precision required for "pretty decent non-trivial code" is much higher than prose that looks like it was written by an educated human, so I share the idea that if it was augmented - even in really stupid ways like asking the IDE if it would even compile, in the case of Copilot, before suggesting it to the user - it would work much better at a much lower effort than increasing it's understanding implicitly by orders of magnitude.