4 ms·

Do you have a link for that?

• Const-me 4y ago
  Source code: https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp
  • kid64 4y ago
    My apologies @Const-me, are you referring to the module "convert-pth-to-ggml.py" in that repo? That appears to be the only Python in there.
    • hnfong 4y ago
      The link from GP is the CPU only one implemented in C++. The python + GPU one can be found on the official facebook repo: https://github.com/facebookresearch/llama https://github.com/facebookresearch/llama (Presumably GP thought this was already known to everyone so they pasted the other link)
      • Const-me 4y ago
        It seems that question can be interpreted in two ways: 1. Do you have a link which proves the implementation being discussed is CPU-only? 2. Do you have a link to the official Python-based implementation? When I wrote the above answer, I was only aware about the first interpretation.