3 ms·
Seq2seq translator (which trains to translate from one human language to another) is not a good architecture to learn computer code.
by nayname 8y ago
Seq2seq translator (which trains to translate from one human language to another) is not a good architecture to learn computer code.
- andyonthewings 8y agoWhat can be used instead?
- nayname 8y agoIt would be easier not to represent computer code as a string of sentences, but to get some semantic structure from it. One way is to use a syntax tree - https://openreview.net/forum?id=rkxY-sl0W https://openreview.net/forum?id=rkxY-sl0W
- nayname 8y agoAnother thing I like is NPI - https://arxiv.org/pdf/1511.06279.pdf https://arxiv.org/pdf/1511.06279.pdf. At the end, you can find NPI vs Seq2Seq charts