3 ms·
You can do "constrained decoding" on a code model which keeps it grammatically correct. But we haven't gotten diffusion working well for text/code, so generati
by astrange 3y ago
You can do "constrained decoding" on a code model which keeps it grammatically correct.
But we haven't gotten diffusion working well for text/code, so generating long files is a problem.
- DougBTX 3y agoRecent results for code diffusion here: https://www.microsoft.com/en-us/research/publication/codefusion-a-pre-trained-diffusion-model-for-code-generation/ https://www.microsoft.com/en-us/research/publication/codefus... I'm not experienced enough to validate their claims, but I love the choice of languages to evaluate on: > Python, Bash and Excel conditional formatting rules.