3 ms·

Meta is actively trying to take down publicly available copies of LLaMA: https://github.com/github/dmca/blob/master/2023/03/2023-03-21-meta.md https://github.co

Meta is actively trying to take down publicly available copies of LLaMA: https://github.com/github/dmca/blob/master/2023/03/2023-03-21-meta.md https://github.com/github/dmca/blob/master/2023/03/2023-03-2...

techdragon 4y ago
Haha good luck with that now… it’s in the digital ether available to all on IPFS… at worst you might have to ask around for someone to help you, but its “distributed” widely enough now I don’t think even a billionaire can put this back into the bottle.
- smoldesu 4y ago
  And in 6 months it will be outdated. So long LLaMA, and thanks for all the fish. You will be remembered as the slightly-sexier version of GPT-J that was most well-renowned for... checks clipboard ...Macbook acceleration.
  - Taek 4y ago
    LLaMA is part of LLM history in a way that Bard will probably never be
    - smoldesu 4y ago
      That's kinda my point. LLaMA's entire history will be enlightening the great erudites who missed-out on real open models like GPT-Neo. Since Meta won't cooperate with the community to improve on it, it's a dead-end. It's anything but the genesis of local AI.
jhbadger 4y ago
Given that free alternatives like Vicuna (from the University of California and CMU) are better than LLaMA, are freely and legally available for download, and are compatible with code like llama.cpp, even if every copy of LLaMA is taken down it will have no effect on the development of chatbots. It might even improve things as people who would otherwise go for the better known LLaMA will move towards these newer, better, models.
- Tepix 4y ago
  They are all built on top of Llama…
  - jhbadger 4y ago
    Yes, but that doesn't matter mow. The University of California has released Vicuna as open source. It doesn't need the Llama model to be installed at this point. Nor do you need any of Meta's code to run it either as you can use llama.cpp (not created by Meta). That's the whole point of the article. It's open source now. There's nothing Meta can do.
    - sp332 4y ago
      This is incorrect. According to the official https://github.com/lm-sys/FastChat#vicuna-weights https://github.com/lm-sys/FastChat#vicuna-weights you need the original Llama weights before applying the Vicuna diff.
      - jhbadger 4y ago
        Seriously, you can download the Vicuna model and run it locally with llama.cpp. I've done it!
        oidar 4y ago
        It's built off of llama though - you can't get to Vicuna without having the llama model weights.
        int_19h 4y ago
        It doesn't matter if you merge the LoRA, the resulting weights are still a derived work - assuming, that is, that weights are copyrightable in the first place (which is still a big if).
        MacsHeadroom 4y ago

techdragon 4y ago

Haha good luck with that now… it’s in the digital ether available to all on IPFS… at worst you might have to ask around for someone to help you, but its “distributed” widely enough now I don’t think even a billionaire can put this back into the bottle.

smoldesu 4y ago
And in 6 months it will be outdated. So long LLaMA, and thanks for all the fish. You will be remembered as the slightly-sexier version of GPT-J that was most well-renowned for... checks clipboard ...Macbook acceleration.
- Taek 4y ago
  LLaMA is part of LLM history in a way that Bard will probably never be
  - smoldesu 4y ago
    That's kinda my point. LLaMA's entire history will be enlightening the great erudites who missed-out on real open models like GPT-Neo. Since Meta won't cooperate with the community to improve on it, it's a dead-end. It's anything but the genesis of local AI.

jhbadger 4y ago

Given that free alternatives like Vicuna (from the University of California and CMU) are better than LLaMA, are freely and legally available for download, and are compatible with code like llama.cpp, even if every copy of LLaMA is taken down it will have no effect on the development of chatbots. It might even improve things as people who would otherwise go for the better known LLaMA will move towards these newer, better, models.

Tepix 4y ago
They are all built on top of Llama…
- jhbadger 4y ago
  Yes, but that doesn't matter mow. The University of California has released Vicuna as open source. It doesn't need the Llama model to be installed at this point. Nor do you need any of Meta's code to run it either as you can use llama.cpp (not created by Meta). That's the whole point of the article. It's open source now. There's nothing Meta can do.
  - sp332 4y ago
    This is incorrect. According to the official https://github.com/lm-sys/FastChat#vicuna-weights https://github.com/lm-sys/FastChat#vicuna-weights you need the original Llama weights before applying the Vicuna diff.
    - jhbadger 4y ago
      Seriously, you can download the Vicuna model and run it locally with llama.cpp. I've done it!
      - oidar 4y ago
        It's built off of llama though - you can't get to Vicuna without having the llama model weights.
      - int_19h 4y ago
        It doesn't matter if you merge the LoRA, the resulting weights are still a derived work - assuming, that is, that weights are copyrightable in the first place (which is still a big if).
        MacsHeadroom 4y ago