3 ms·
Is there any research being done where people are using large language models to generate or transform syntax trees for programs I saw a mention of this on Twi
by mindcrime 4y ago
Is there any research being done where people are using large language models to generate or transform syntax trees for programs
I saw a mention of this on Twitter the other day. I have not read the paper, and it's anonymous, so I don't know how serious and/or credible this is. But it was apparently an actual ICLR submission, so it might be worth a look. Not sure it's exactly what you're interested in, but it seems like it might be in the same neighborhood.
https://openreview.net/forum?id=SKat5ZX5RET https://openreview.net/forum?id=SKat5ZX5RET
- zomglings 4y agoThanks for the link. This is interesting work, although not related to operations on program syntax trees. From what I understand, they are using reinforcement learning techniques inspired by AutoML to learn architectures for language models that are effective at code generation. They have reinforcement learning models optimizing the neural networks that generate code. Pretty cool and reminds of work that followed on the heels of AutoML to build neural networks to automatically solve arbitrary ML problems (with the problem as the input parameter).