3 ms·
In Battle over A.I., Meta Decides to Give Away Its Crown Jewels
- RcouF1uZ4gsC 4y agoInteresting that this is the approach advocated in the leaked Google memo. One thing is that it has received a lot of attention. For example the llama.cop project has significantly made it easier to build and run on consumer hardware. In addition, there are a lot of fine tunings available for that model.
- mungoman2 4y agoWell it's not really the model itself that is the valuable part, it's what you build on top of it. And here nobody knows what the killer app is (yet)
- deafpolygon 4y agoThis is a common strategy - when you don't know what the product is, rather than wait until your competitor gets a strong lead- undercut them by releasing your own product in the "spirit" of giving something away. Stir up interest and hope the dust cloud is enough to obscure your competitor long enough until you figure out how to monetize it.
- toss1 4y agoYup, and also remember to scoop up any interesting ideas generated and produced by people working on your "open" thing, then monetize that. Harnessing crowdsourced free work...
- metadat 4y agohttps://archive.today/yAfwi https://archive.today/yAfwi
- dravigon 4y agothank kind stranger
- barbariangrunge 4y agoSo it is officially open source now, and not just being pirated after the leak?
- MichaelRazum 4y agoGuess no. That is the trick right? Let's see what people build. If it is good copycat it. If you build something very cool that makes money, be ready being sued by meta... PS: Not an expert just speculating.
- seydor 4y agoPeople built an entire ecosystem around llama. This could benefit FB, however their models are too limited to compete with chatGpt, so the open source tools arent particularly useful to them. FB is probably using better models by now. OTOH the open source community has an entire set of tools for the moment when Llama will be replaced with something better and completly open sourced model. at the moment , OSS seems to have benefited from their release.
- MichaelRazum 4y agoVicuna looks pretty good. But as said, commercial use not possible. Why do you think that Llama can be replaced? I mean it is extremely costly to train that thing. And it is there even a clean open source data set for the task? PS: wouldn't be surprised if Meta, OpenAi, or google will train something for a Billion $ in costs of compute or more.
- seydor 4y agothe 2048 sequence length makes it uncompetitive, especially now that we are entering ~infinite-length bots. $1M for training is peanuts for FB. There are open datasets like redPajama and alternative models are (hopefully) coming up
- Havoc 4y agoIt was never "leaked" but rather available on request after agreeing to terms. It found its way onto torrents shortly thereafter naturally
- dtagames 4y agoThe big deal here is releasing the model pre-trained. The training part would cost $1M in compute costs if you had to do it in-house. The idea is that a company or developer downloads the model already trained on natural language. Then you add your additional documents and data and prompt it for answers internally, rather than through a service like OpenAI.
- aschearer 4y agoCommoditize your complement -- and if it's your competitor's essential thing, all the better. PS I wish I could get the NYT to write marketing pieces for my stuff!
- nylonstrung 4y agoNo way they released it intentionally by distributing on ...4chan
- cyanydeez 4y agoIf it's good enough for republicans and Russians, surely this is the truth
- Havoc 4y ago>Give Away Its Crown Jewels More like handed out good replicas. The model provided comes with enough legal strings attached that it's only really usable in the unofficial turn a blind eye to licenses context. i.e. Hobbyist, researches and casual use.
- simmerup 4y agoUnless you’re in countries that don’t respect that shit like China, Russia and etc. In which case you may have just helped nasty regimes