3 ms·

This sounds quite nice and like something I'd be interested in. C/C++?

• behnamoh 3y ago
  Thanks! I'm using Python but with heavy use of types (miss my c++ era). I wanted to be able to call llama.cpp from Python, but I didn't want to use the llama-cpp-python wrapper because it automatically downloads and builds llama.cpp, which I didn't want to do. I like the simplicity of llama.cpp and its unix philosophy of doing one thing well, so I prefer to build llama.cpp myself and then call it from Python.
  • sho_hn 3y ago
    Roger. I'll keep an eye out, do post it on HN :-)
    • behnamoh 3y ago
      Copy that. Will post it on HN in the next few days!
  • LoganDark 3y ago
    > I didn't want to use the llama-cpp-python wrapper because it automatically downloads and builds llama.cpp As in, after you've installed the package, it will pause your application at runtime to download and build llama.cpp? That's not how bindings are supposed to work! That sounds seriously cursed.
    • deleted 3y ago
      [deleted]
    • behnamoh 3y ago
      I meant that when you install llama-cpp-python, it downloads and builds llama.cpp _for_ you, which I don't like because then you're stuck with llama.cpp commits that are kinda old.