4 ms·
we really need LLM trained on AST, instead of token, is there any research on this?
by slt2021 1y ago
we really need LLM trained on AST, instead of token, is there any research on this?
- tough 1y agoASTrust: Towards More Trustworthy and Interpretable LLMs for Code through Syntax-Grounded Explanations https://arxiv.org/abs/2407.08983 https://arxiv.org/abs/2407.08983 AST-T5: Structure-Aware Pretraining for Code Generation and Understanding https://arxiv.org/abs/2401.03003 https://arxiv.org/abs/2401.03003 CodeGRAG: Bridging the Gap between Natural Language and Programming Language via Graphical Retrieval Augmented Generation https://arxiv.org/abs/2405.02355 https://arxiv.org/abs/2405.02355
- nielstron 1y agoThe downside is that you need to properly preprocess code, have less non-code Training Data, and can not adapt easily to new programming languages