3 ms·
I wonder if this would help especially for computer code generation, where what is output at a given step may materially depend on what would be written at a la
by mbil 2y ago
I wonder if this would help especially for computer code generation, where what is output at a given step may materially depend on what would be written at a later step.
- mbil 2y agoAnd, maybe prohibitively slow, perhaps integrate some kind of linting or syntax checking as part of the rejection sampling. I.e. burst sample N potential generated snippets in parallel, reject those that are syntactically invalid.
- barfbagginus 2y agoIt would be nice if it could diffuse right on the AST. That would ensure each generated item passes a syntax check, without the waste of rejection sampling