3 ms·
I see no one has referenced the written by ai paper itself https://arxiv.org/abs/2608.13568 https://arxiv.org/abs/2608.13568 https://github.com/agentconnect-md
by genxy 1mo ago
I see no one has referenced the written by ai paper itself https://arxiv.org/abs/2608.13568 https://arxiv.org/abs/2608.13568
https://github.com/agentconnect-md/lsp-vs-grep-token-study https://github.com/agentconnect-md/lsp-vs-grep-token-study
The author uses their own harness, I'd want to see if what they are seeing is related to the harness, they should at the minimum also use CC which has direct LSP support.
Their metric is token economy, many of us don't pay per token and capability in terms of difficulty and quality are a more important metrics for the kinds of work I do. I'd want those tested as well.
- poytr1 1mo agoYes, I’m the author of this paper. One correction: the paper is inaccurate on this point. If you look at the implementation(https://github.com/agentconnect-md/lsp-vs-grep-token-study/blob/58b0c1a2daad83cbb2731b3b4e951482a81b0454/harness/harness.py#L27 https://github.com/agentconnect-md/lsp-vs-grep-token-study/b...), the harness is actually based on Claude Code, with a system prompt and custom LSP tools registered. Sorry for the confusion! :)