3 ms·

Huh. This surprises me. Digging, it seems it looks like it comes down to interpreted + dynamically typed vs compiled and statically typed. TIL. If i were to

• dnautics 5mo ago
  and yet dynamically typed elixir wipes the floor with go. https://github.com/Tencent-Hunyuan/AutoCodeBenchmark/blob/main/figures/exp_acb.png https://github.com/Tencent-Hunyuan/AutoCodeBenchmark/blob/ma...
  • bontaq 5mo ago
    LLMs get ridiculous with elixir, especially with the repl, runtime, and ability to hot reload / directly test functions. It's really surprising to me it hasn't caught on more but I guess you have to see it to believe it.
    • cultofmetatron 5mo ago
      built my startup in elixir and can concur. elixir has a relatively consistent syntax that makes for a pretty good target for llms. In my opinion, the only thing holding elixir back as an llm deliverable is that there's not as much training data for llms to work with. Of course if we had a new AI that could be trained on a minimum of existing training data, common lisp would absolutely beat out everything else. everything you mentioned about elixir (repl, runtime, and ability to hot reload / directly test functions) are possible and were invented in lisp with an AST instead of a syntactic language as the ultimate build artifact. CL lets you recover from exceptions and rewind the stack before reloading your fixes and continuing. I can't even fathom the workloads an LLM could conceive of working with that.
  • nojito 5mo ago
    This doesn't say what you think it does. Language like elixir were given easier problems to solve when compared to other languages.
    • dnautics 5mo ago
      Where does the paper say this?
      • nojito 5mo ago
        Pages 3-6