6 ms·

I love how LLMs have got the attention of proper programmers such that the Python mess is getting cleaned up.

• faitswulff 4y ago
  How so?
  • kccqzy 4y ago
    There are two distinct kinds of jobs: ML researchers and software engineers. A lot of ML researchers write pretty bad code by software engineering standards but that's okay; it's not their job to produce clean code. They string together libraries in Python and do a lot of experimentation and analysis. When they produced something ready to be productionized, software engineers then come in and optimize things. This is totally the right way. Make it work, then make it right, then make it fast.
    • Hortinstein 4y ago
      Not sure if you came up with "Make it work, then make it right, then make it fast." but I just screenshotted it and made it the mantra for my current project...which is by far more complicated than anything I have done as a side project. I am struggling with the desire to go "make it right" as I work on shipping the deployable prototype (right now running on cloud services I control)...thanks for this
      • faitswulff 4y ago
        https://wiki.c2.com/?MakeItWorkMakeItRightMakeItFast https://wiki.c2.com/?MakeItWorkMakeItRightMakeItFast > This formulation of this statement has been attributed to [KentBeck][0]; it has existed as part of the [UnixWay][1] for a long time. [0]: https://wiki.c2.com/?KentBeck https://wiki.c2.com/?KentBeck [1]: https://wiki.c2.com/?UnixWay https://wiki.c2.com/?UnixWay
    • buzzert 4y ago
      Funny enough, this tracks the early history of Google as well. It was originally written by Larry Page and Sergey Brin (both grad students at the time) in Python, then Sanjay Ghemawat rewrote the whole thing in C++.
      • heap_perms 4y ago
        That sounds very interesting. Anyone know where I can find more on this story?
        • buzzert 4y ago
          I learned this from Steven Levy's great book, "In the Plex": https://www.amazon.com/Plex-Google-Thinks-Works-Shapes/dp/1416596585 https://www.amazon.com/Plex-Google-Thinks-Works-Shapes/dp/14...
    • faitswulff 4y ago
      I meant "how is the Python mess getting cleaned up," rather.
    • imranq 4y ago
      "Make it work, then make it right, then make it fast" is brilliant. This should be a universal principle for almost everything
    • visarga 4y ago
      > ML researchers and software engineers. A lot of ML researchers write pretty bad code by software engineering standards but that's okay Yes. When you have to try out dozens of research ideas, most of which won't pan out, then you stop writing engineering-style code and switch to hacker mode. Why make it nice when you could be trying 2 more ideas in the meantime. Most of research code it is going to the trash anyway.
  • seydor 4y ago
    C has an almost infinite horizon for optimization. Python is good prototypes but we are beyond that stage now
    • lostmsu 4y ago
      99% of LLM evaluation with PyTorch was already done in C++. These .cpp projects don't improve anything for performance. They just drop dependencies necessary for training and experimentation.
      • seydor 4y ago
        Optimization isn't just about speed. As you said, dropping dependencies makes it portable, embeddable, more versatile
        • jart 4y ago
          It's also nice to not lose your mind over how crazy Python and Docker are, when all you want to do is run inference in a shell script as though it were the `cat` command. That sacred cow is going to have to come out of the temple sooner or later, and when that happens, people are going to think, wow, it's just a cow.
          • Max-Limelihood 4y ago
            Have you tried Julia for this instead?
• mhh__ 4y ago
  Now it's a C mess!