4 ms·
Did you consider first asking LLM to explain what a code snippet does and use that instead? It'd significantly increase the costs though.
by applgo443 3y ago
Did you consider first asking LLM to explain what a code snippet does and use that instead?
It'd significantly increase the costs though.
- williamzeng0 3y agoI didn't mention this point, but we actually do that during the modification. We ask the LLM to extract the necessary subcontext from the main context. It doesn't increase the costs much, but it does help performance because the unnecessary context is stripped away.