3 ms·
> * Way way way more code in the training set. Why not convert the training code to AST?
by jonfw 1y ago
> * Way way way more code in the training set.
Why not convert the training code to AST?
- mgsloan2 1y agoYou could, but it is extremely expensive to train an LLM that is competitive on coding evals. So, I was assuming use of a model someone else trained. Also, if it is only trained on code, it's likely to miss out on all the world knowledge that comes from the rest of the data.
- exe34 1y agofine tune instead of training from scratch might help.