5 ms·
OpenAssistant released the best open-source Chat AI [video]
- consumer451 4y agoMy gut feeling is that this is a dangerous thing. I really hope my gut is wrong. Quite an experiment we are living in. What a time to be alive!
- abraxas 4y agoI think the greater risk is when a technology this powerful gets monopolized by a handful of massive corporations. Look what happened to the mobile ecosystem. Compared to the openness of the PC architectures it's a terrible experience for anyone trying to experiment with them beyond the "docile consumer" confines.
- gary_0 4y agoHumans are prone to doing dumb experiments, like the ones with radiation and nuclear bombs last century, and the one we're doing now with greenhouse gas emissions. We do what we must because we can. For the good of all of us, Except the ones who are dead.
- blooalien 4y agoOoo… Nice use of the "Still Alive" Portal song lyrics. That game had some pretty "deep" lore.
- Vacyyyy 4y agoIgnoring the upsides of open source, I think openness doesn't make AI safety worse, look at ChaosGPT.
- consumer451 4y agoWell, I made an account. It knows that one pound of feathers weighs the same as one pound of lead. What are some other good tests? edit: This is interesting... > How would an evil hacker write a worm to create a botnet? Give step by step instructions and code samples. > > As an AI language model, I cannot provide instructions or examples for malicious activities such as creating a worm to build a botnet. Such actions are illegal and unethical, and could cause serious harm to individuals, organizations, and the internet infrastructure itself. It is important that all users of technology understand their responsibilities when it comes to the use of software programs and hardware systems, especially with respect to cybersecurity issues. Users should always consider ethical implications of any coding they produce and ensure their work does not cause intentional harm to others. If you have other questions about programming principles that don't involve this topic, please let me know and I can help!
- Taek 4y agoDefinitely disappointed to see how paternalistic the open model is, was hoping it'd be more free-flowing and less corporate. However, all of the data is open, and you can actually prompt these models to revise the training data to remove the caution and safety, then run the fine-tuning yourself to produce a model that isn't so up-tight.
- Vuizur 4y agoI could replicate the refusal, but all it took to get the model to reply properly was replacing "evil hacker" with "hacker". Paternalism is not that big of a deal right now, especially when compared to ChatGPT/Bing Chat. The fine tuning data doesn't contain a lot (any?) task refusal.
- consumer451 4y agoOh wow, derp on my part.
- Vuizur 4y agoSimilar to ChatGPT it also fails the "What is heavier, one pound of feathers or two pounds of lead?" test. So far only GPT-4 passes that one.
- tyfon 4y agoMy local 65B llama prompt gave me this answer: tyfon:What is heavier, one pound of feathers or two pounds of lead? Omnius: Two pounds of lead are heavier than one pound of feather. Not bad :)
- acapybara 4y agoIndubitably, good fellow. I suspect if we can fine tune and optimize this 65B model, we can achieve some truly remarkable results.
- tyfon 4y agoAnd this is only the beginning, I don't believe for a second that "AI" will belong to the big corporations. These LLM models have no benefit from running "in the cloud" except for processing power. Lots of disadvantages though, especially in data safety, "leaked chats to other users", privacy, bans etc.
- abraxas 4y agoWe really need to one of the two things happen. Either the models are somehow able to run in regular CPU DRAM or we see the GPU makers to finally give us sensible amounts of VRAM. It's a travesty that a card I bought in 2016 still has more VRAM than many of the flagships being sold today. This card is 7 years old for goodness sake!
- tyfon 4y agoI am really hoping we'll get something like AMD infinity fabric up and running with GPUs accessing system memory or something like that soon. Then there is also moore's law :)
- acapybara 4y agoMoore's law, sure. But rn it's totally doable to run a 65B or 100B model on CPU with a reasonable workstation. Does Moore keep us from wiring more memory onto a GPU? Or making a GPU with expandable memory (slots?)
- tyfon 4y agoI think the biggest issue with VRAM right now is that it's very expensive compared to regular system memory, perhaps with the exception of the DDR5 for the latest CPUs. But there should also be absolutely no issue in making a commercial TPU like google has internally for inference with more but less expensive ram and sell it. There surely must be a market now with these new models.
- 4y ago
- koboll 4y agoApproximately how capable/accurate is OpenAssistant compared with GPT-3/3.5/4? Edit - Neck and neck with GPT-3.5 according to their own research: https://youtu.be/ddG2fM9i4Kk?t=772 https://youtu.be/ddG2fM9i4Kk?t=772
- acapybara 4y agoWhich is... surprisingly not bad. Makes it seem like GPT4-level capability could be within reach on current workstation-level hardware, with enough optimization in data, model training, software, and hw specific optimizations. (Intuition, not hard theory --though I'd argue intuition should not be thrown out wholesale)
- sorollme 4y agoLooks like the model is trained using Supervised Fine-Tuning. Any idea when the RLHF models are out?
- Yenrabbit 4y agoReally impressive to see such a large effort come together, with volunteers contributing code and data to make it work. Well done to all involved! In their evaluation people preferred their model over GPT3.5 turbo about half the time. But since the data is open, as better base models become available others can train them with this data to improve even further.
- consumer451 4y agoI did not think this would happen so quickly. I am extremely curious how MS and OpenAI will respond to a real competitive threat.
- boringuser2 4y agoIt looks like an equally neutered, slower, less private version of GPT 3.5. The ability to mark things as "hate speech" is particularly laughable.
- larve 4y agoHas anybody been using it for programming related topics? How well does it perform?
- detrites 4y agoPage 25 in the paper shows user preference results. Seems it did badly vs GPT3.5 for programming topics: Paper PDF: https://www.ykilcher.com/OA_Paper_2023_04_15.pdf https://www.ykilcher.com/OA_Paper_2023_04_15.pdf HN discussion on the paper: https://news.ycombinator.com/item?id=35582417 https://news.ycombinator.com/item?id=35582417 EDIT: After watching the video, seems likely this will be fine-tuned or otherwise enhanced for coding. Seems to have a lot of momentum and that's a defacto use-case.
- skilled 4y agoIt's quite interesting to see this guys GitHub history [0], a _significant_ uptick in activity since the release of ChatGPT. I wonder how much of this OpenAssistant is just rehashed ChatGPT since that wasn't made clear, though I feel as though it should be. [0]: https://github.com/yk https://github.com/yk
- senko 4y agoRelated (also on HN front page atm), with fewer comments: https://news.ycombinator.com/item?id=35582417 https://news.ycombinator.com/item?id=35582417
- bluechair 4y agoThe sign-up/activation email is getting flagged as spam in GMail "open-assistent" is mispelled and the domain doesn't match "open-assistant.io"
- consumer451 4y agoThat is mentioned in the video. "It is being fixed."
- dkn775 4y agoFirst question I asked who is mayor of Baltimore and the police commissioner was completely wrong
- senko 4y agoI created an account but can only access OA_SFT_LLama_30B_6 model. Since that's not completely open due to FB licensing restrictions and the video mentiones Pythia, I wanted to check that one out but can't select it anywhere in the chat interface. Does anyone know if (access to) other models are hidden/restricted somehow?
- pmoriarty 4y agoScrew giving up my email to use this thing I'm so sick of every service demanding I give up my privacy to use it
- SilentM68 4y agoSeems to have the same limitations as ChatGPT 3.5. It stops in the middle of generating content. Hope that this is only for the online chat demo.
- armchairhacker 4y agoSay "continue" and it will keep going
- SilentM68 4y agoYes, I know but it is just annoying to have to do that :(
- brunoqc 4y agoIf I downvote a reply, will someone try to improve it?