7 ms·
with both this and https://Open-Assistant.io https://Open-Assistant.io, I believe we have entered the Stable Diffusion era of large language models
by return_to_monke 3y ago
with both this and https://Open-Assistant.io https://Open-Assistant.io, I believe we have entered the Stable Diffusion era of large language models
- idle_zealot 3y agoDidn't Open Assistant just announce that they weren't releasing their model weights due to safety concerns? Seems like another "Open" AI initiative.
- deleted 3y ago[deleted]
- circuit10 3y agoUnless something changed, I thought it was that they literally cannot legally release the weights that are based on LLaMA (except maybe with an xor thing) so they’re going to train it based on something else
- mindcrime 3y agoIs any of the Open Assistant stuff based on LLaMA? I thought they release (at least some version) before LLaMA even dropped?
- circuit10 3y agoYes, there’s also something based on Pythia but it’s a smaller model
- selfhoster11 3y agoIIRC, the video said they will train it on a properly open-source model as well.
- akiselev 3y agoThat was a joke in the release video. The Pythia model is already released at [1] and the deltas for the LLaMa model should be up here [2] in the next few days. [1] https://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5 https://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-... [2] https://huggingface.co/OpenAssistant/oasst-llama-based-models https://huggingface.co/OpenAssistant/oasst-llama-based-model...
- RandomBK 3y agoUnfortunately [2] is just a placeholder for now, but it does look like the intent is to publish the weights.
- Taek 3y agoIt's also relatively cheap to make your own llama-30 weights, the real value of OpenAssistant is in the training data, and all of that data has been made available. The OpenAssistant effort gets an A+ for open source contributions.
- fortyseven 3y agoThere was a dumb joke along those lines in an announcement video, meant as a jab at OpenAI. It's easy to miss the "just kidding". (I did, initially.)
- deleted 3y ago[deleted]
- detrites 3y agoThe announce video by Yannic contained a (lengthy) gag to that effect, has it been taken out of context or did now something actually happen? https://youtube.com/watch?v=ddG2fM9i4Kk&t=132 https://youtube.com/watch?v=ddG2fM9i4Kk&t=132 It's easy to miss but after the negative build-up he says: "and... I'm kidding!"
- ricardobeat 3y agoDangerous gag, he said “I’m joking” so quickly it’s very easy to miss. I imagine the commenter is not alone in having that wrong impression.
- idle_zealot 3y agoOh, ha, yeah this is exactly the gag I fell for. I just noped out of the video and wrote off the project as this was the first I ever heard of them, and their website just has a signup and no downloads I could see. Too bad my original comment is too old to edit.
- bugglebeetle 3y agoOnly if they actually start performing at the level of OpenAI’s models. I’m not a fan of StableDiffusion, but at least their models work at general parity with private offerings. All the LLama derivatives and OpenAssistant stuff performs far below GPT-3.5 for everything I’ve tested.
- GaggiX 3y ago>I’m not a fan of StableDiffusion For some technical reason?
- bugglebeetle 3y agoNo, technically it’s all very impressive. My displeasure with them was there doing a Napster-style maneuver to force artists into accepting AI art generation
- pluijzer 3y agoDo you mean the use of uncredited use of artists artwork without paying royalties for the training set or AI art generation in general?
- bugglebeetle 3y agoWhat I mean is releasing a free service out into the world that allows anyone to effectively pirate an artist’s work. Their intention was obviously to be rewarded by established players for doing this bit of dirty work, forcing artists to accept terms they wouldn’t have otherwise.
- CuriouslyC 3y agoThe training was legal, and artists don't have a say under the current law, so your analogy doesn't hold.
- bugglebeetle 3y ago