4 ms·

So it is officially open source now, and not just being pirated after the leak?

• MichaelRazum 3y ago
  Guess no. That is the trick right? Let's see what people build. If it is good copycat it. If you build something very cool that makes money, be ready being sued by meta... PS: Not an expert just speculating.
  • seydor 3y ago
    People built an entire ecosystem around llama. This could benefit FB, however their models are too limited to compete with chatGpt, so the open source tools arent particularly useful to them. FB is probably using better models by now. OTOH the open source community has an entire set of tools for the moment when Llama will be replaced with something better and completly open sourced model. at the moment , OSS seems to have benefited from their release.
    • MichaelRazum 3y ago
      Vicuna looks pretty good. But as said, commercial use not possible. Why do you think that Llama can be replaced? I mean it is extremely costly to train that thing. And it is there even a clean open source data set for the task? PS: wouldn't be surprised if Meta, OpenAi, or google will train something for a Billion $ in costs of compute or more.
      • seydor 3y ago
        the 2048 sequence length makes it uncompetitive, especially now that we are entering ~infinite-length bots. $1M for training is peanuts for FB. There are open datasets like redPajama and alternative models are (hopefully) coming up
• Havoc 3y ago
  It was never "leaked" but rather available on request after agreeing to terms. It found its way onto torrents shortly thereafter naturally