3 ms·
Indeed, it's intuitively more efficient for LLMs to operate on ASTs instead of raw source code. I came across a recent paper[1] that takes this approach. [1]:
by woadwarrior01 3y ago
Indeed, it's intuitively more efficient for LLMs to operate on ASTs instead of raw source code. I came across a recent paper[1] that takes this approach.
[1]: https://arxiv.org/abs/2305.00909 https://arxiv.org/abs/2305.00909
- kevinlu1248 3y agoThis is interesting, I'll take a look. My main concern with running this in production is that there is more text data in the world than code. Further, a pure tree-manipulation model has less explainabilities since you can always ask GPT-4 what it's thinking.
- woadwarrior01 3y agoIIUC, doc-strings and comments in code will still be processed as text.