2 ms·
The problem with LLMs for code editing is that they generate new tokens, instead of performing in place context editing (IPCE). It probably shouldn't be that di
by imtringued 3y ago
The problem with LLMs for code editing is that they generate new tokens, instead of performing in place context editing (IPCE). It probably shouldn't be that difficult to just add a final layer that is trained to perform IPCE. Then you would get a lot of the benefits of MemGPT without an external tool.
The LLM could go back and only rewrite a handful of lines.