3 ms·

Well, there are certainly kinds of code LLMs would struggle with, but people generally underestimate what LLMs are capable of. E.g. Victor Taelin is implementi

Well, there are certainly kinds of code LLMs would struggle with, but people generally underestimate what LLMs are capable of. E.g. Victor Taelin is implementing ultra-advanced programming language/runtime writing almost all code using LLM now. Runtime (HVM) is based on Interaction Calculus model which was only an obscure academic curiosity until Taelin started working on it. So a hypothesis that LLMs are only capable of copying bits of code from Stack Overflow shall be dismissed.

thesz 11mo ago
I took a look at the Taelin's work [1]. [1] https://github.com/HigherOrderCO/HVM https://github.com/HigherOrderCO/HVM From my understanding, main problem there is a compilation into (optimal) CUDA code and CUDA runtime, not language or internal representation per se. CUDA is hard to debug, some help can be warranted. BTW, this HVM thing smells strange. The PAPER does not provide any description of experiments where linear parallel speedups were achieved. What were these 16K cores? What were these tasks?
- killerstorm 11mo ago
  Taelin is experimenting with possible applications of interaction calculus. That CUDA thing was one of experiments, and it didn't quite work out. Currently he's working on a different thing: a code synthesis tool. AFAIK he got something better than anything else in this category, but whether it's useful is another question.
  - thesz 11mo ago
    > something better than anything else in this category That is a strong statement. [1] https://en.wikipedia.org/wiki/Id_(programming_language) https://en.wikipedia.org/wiki/Id_(programming_language) Id [1] was run on the CM-5 (then) supercomputer and demonstrated superlinear parallel speedups on some of the tasks. That superlinear speedup was due to better cache utilization on individual nodes. In some of the tasks the amount of parallel execution discovered by Id90 would lead to overflow of content-addressable memory and Id90's runtime implemented throttling to reduce available parallelism to make things to be done at all. Does the PAPER of HVM refers to Id (Id90 to be precise)? No, it does not. This is serious negligence of Taelin.
    - killerstorm 11mo ago
      I mean their code synthesis thing (i.e. "generate function code from input-output pairs") is better than anything from academia by many orders of magnitude. But it's not published yet. I dunno why you choose to be so critical. Taelin isn't really selling his stuff, and his previous stuff was just an open source experiment. It's not an academic paper which claims something. And HVM1 is irrelevant now. Their new stuff isn't about general performance but code synthesis
keithba 11mo ago
I’ve also experimented with using rust to create a new programming language where I vibe coded (eg never wrote myself). My opinion is that it’s quite capable with disciplined management. https://github.com/GoogleCloudPlatform/aether https://github.com/GoogleCloudPlatform/aether Note: the syntax is ugly as a trade-off to make it explicit and unambiguous for LLMs to use.

thesz 11mo ago

I took a look at the Taelin's work [1]. [1] https://github.com/HigherOrderCO/HVM https://github.com/HigherOrderCO/HVM From my understanding, main problem there is a compilation into (optimal) CUDA code and CUDA runtime, not language or internal representation per se. CUDA is hard to debug, some help can be warranted. BTW, this HVM thing smells strange. The PAPER does not provide any description of experiments where linear parallel speedups were achieved. What were these 16K cores? What were these tasks?

killerstorm 11mo ago
Taelin is experimenting with possible applications of interaction calculus. That CUDA thing was one of experiments, and it didn't quite work out. Currently he's working on a different thing: a code synthesis tool. AFAIK he got something better than anything else in this category, but whether it's useful is another question.
- thesz 11mo ago
  > something better than anything else in this category That is a strong statement. [1] https://en.wikipedia.org/wiki/Id_(programming_language) https://en.wikipedia.org/wiki/Id_(programming_language) Id [1] was run on the CM-5 (then) supercomputer and demonstrated superlinear parallel speedups on some of the tasks. That superlinear speedup was due to better cache utilization on individual nodes. In some of the tasks the amount of parallel execution discovered by Id90 would lead to overflow of content-addressable memory and Id90's runtime implemented throttling to reduce available parallelism to make things to be done at all. Does the PAPER of HVM refers to Id (Id90 to be precise)? No, it does not. This is serious negligence of Taelin.
  - killerstorm 11mo ago
    I mean their code synthesis thing (i.e. "generate function code from input-output pairs") is better than anything from academia by many orders of magnitude. But it's not published yet. I dunno why you choose to be so critical. Taelin isn't really selling his stuff, and his previous stuff was just an open source experiment. It's not an academic paper which claims something. And HVM1 is irrelevant now. Their new stuff isn't about general performance but code synthesis

keithba 11mo ago

I’ve also experimented with using rust to create a new programming language where I vibe coded (eg never wrote myself). My opinion is that it’s quite capable with disciplined management. https://github.com/GoogleCloudPlatform/aether https://github.com/GoogleCloudPlatform/aether Note: the syntax is ugly as a trade-off to make it explicit and unambiguous for LLMs to use.