3 ms·
> And code is just text. In fact, it’s structured text, specifically written for a machine to understand. It's not just text, it's logic and it involves a lot
by proc0 4y ago
> And code is just text. In fact, it’s structured text, specifically written for a machine to understand.
It's not just text, it's logic and it involves a lot of creativity (if not, there is a library and the problem is solved). I don't think LLMs can reason at that level yet, and I doubt that transformers is all that is needed there.
GPT4 still makes mistakes, and they can only be corrected with a human programmer's guidance. Once this is not needed... we're talking about an AI that can take requirements and reason about it at the human level, understands what the use cases are and can reason about it in such a way that it can iterate on its output until it obtains the desired result based on those requirements. Once that is possible, I think entire industries will have already been wiped out because the same process can be done with any other creative process. If it can iterate on code, surely it will iterate on books and output entire novels (that are interesting to read) from a short premise. It can already do this better than code.