4 ms·
The only thing a model can output is tokens; to achieve this, a tool of converting tokens into operational transformations is required. For example, I have an a
by XYen0n 5mo ago
The only thing a model can output is tokens; to achieve this, a tool of converting tokens into operational transformations is required. For example, I have an ast-grep skill, it will instruct the model to generate ast-grep rules and run ast-grep to perform file modifications.
- basch 5mo agoI am saying to directly output the operational transformation instructions as the tokens. You’re essentially telling it to “write the diff” and then applying the patch. [retain(8), delete(6), insert("very very"), retain(10)]
- ritonlajoie 5mo agothere is a model in openrouter doing exactly this, it generates diffs. forgot the name though
- mike_hearn 5mo agoOpenAI models emit a format similar to a regular diff, but without the line numbers. Look at apply_patch