3 ms·
Going from high-level to the intermediate representation loses a lot of the semantic information about why something has been implemented in a certain way. LLM
by chippiewill 2y ago
Going from high-level to the intermediate representation loses a lot of the semantic information about why something has been implemented in a certain way.
LLMs essentially read their own code when producing it, so if they lose the abstractions then they can lose the context around what they were doing and why they were doing it. It also makes it harder for them to modify their existing code.
I could certainly believe that it's plausible that there's a low level representation that LLMs would find easier than our own languages though - but an existing IR is unlikely to be it.
Also more practically speaking, LLMs struggle to write in languages that they don't have a large training dataset for.