2 ms·
Yes, but in all 4 of these steps you are literally describing the job transformer LLMs were designed to do. We are at 1 (mediocre job) for LLMs in coding right
by daveguy 2y ago
Yes, but in all 4 of these steps you are literally describing the job transformer LLMs were designed to do. We are at 1 (mediocre job) for LLMs in coding right now. Maybe 2 in a few limited cases (eg boilerplate). There's no reason to assume LLMs will ever perform at 3 for coding. For the same reason natural language programming languages like COBOL are no longer used -- natural language is not precise.
- insane_dreamer 2y agoIt seems the consensus is that we will reach level 3 pretty quickly given the pace of development in the past 2 years. Not sure about 4 but I’d say in 10 years we’ll be there.
- daveguy 2y agoThere is definitely no consensus that we will reach level 3 in coding tasks "pretty quickly". (Assuming you are talking about your own definitions of "levels" wrt translation applied to coding -- only proofread/check required)