4 ms·
> if we let this computer create computer language directly? It will be much more efficient for the AI, it will enable much greater options since we are not res
by PartiallyTyped 4y ago
> if we let this computer create computer language directly? It will be much more efficient for the AI, it will enable much greater options since we are not restricted by the programming language, and it will have much less overhead.
I'd argue that it is likely significantly harder for current models due to the sheer number of instructions involved in machine code which is an issue for LLMs due to the their limited window / span via tokens.
What we are seeing with chatGPT is that the model is actually inventing its own abstractions, which - imho - suggests that going up in abstractions instead of down will enable higher productivity for the models.
On one hand, LLMs are very versatile in what they can produce, but otoh that versatility results delusions. This is, imho, akin to alphaGo when it made that single error in the match with Lee Sedol.