3 ms·
My feeling is that for agentic tasks this is not only language design but also LSPs, error messages and static analysis capabilities that dominate the benchmark
by riedel 5mo ago
My feeling is that for agentic tasks this is not only language design but also LSPs, error messages and static analysis capabilities that dominate the benchmarks. It would IMHO be interesting to look into better subsets of python and style/rewrite techniques as well as alternative linter and their effects on performance.
- gtrealejandro 5mo ago[dead]
- kevinautumn 5mo agoA strict compiler is basically a free feedback loop for the LLM.
- andai 5mo agoAlso the human. (I like being told about my bugs when I write them, instead of at some generally much more unpleasant moment in the future.)
- andai 5mo agoBut then why does JS score 50% better? (Almost identical to TypeScript.) Actually, JS can get a surprising amount of "intellisense" as well. Not sure if that was used here though.