6 ms·
Having open source models could be as important as the Linux project imo
by amrb 4y ago
Having open source models could be as important as the Linux project imo
- yorak 4y agoI agree and have been saying for a while that an AI you control and run (be it on your own hardware or on a rented one) will be the Linux of this generation. There is no other way to retain the freedom of information processing.
- visarga 4y agoSimilarly, I think an open model running on local hardware will be a must component in any web browser of the future. Browsing a web full of bots on your own will be a big no-no, like walking without a mask during COVID. And it must be local for reasons of privacy and control, it will be like your own brain, something you want physical possession of.
- gremlinsinc 4y agoI kinda think the opposite, that blockchains true use case is to basically turn the entire internet into one giant botnet that's actually an AI hive mind of processing and storage power. For AI to thrive it needs a shit ton of GPUs AND Storage for the training models. If people rent out their desktop for cryptocurrency and discounted access to the ai tools, then it'll bring down costs for everyone and perhaps at least affect income inequality on a small scale. Most of crypto I've seen so far seem like grifters/scams/etc, but this is one use case I could see working.
- version_five 4y agoYes definitely. If these become an important part of people's lives, they shouldn't all be walled off inside of companies (There is room for both: Microsoft can commission Yankee group to write a report about how the total cost of ownership of running openai models is lower) We (humanity) really lost out on the absence of open source search and social media, so this is an opportunity to reclaim it. I only hope we can have "neutral" open source curation of these and not try to impose ideology on the datasets and model training right out of the box. There will be calls for this, and lazy criticism about how the demo models are x-ist, and it's going to require principles to ignore the noise and sustain something useful
- hgsgm 4y agoMastodon is an open source social media. There are various Open source search engines based on Common Crawl data. https://commoncrawl.org/the-data/examples/ https://commoncrawl.org/the-data/examples/
- xiphias2 4y agoMastodon may be open source, but the instances are controlled by the instance maintainers. Nostr solved the problem (although it's harder to scale, it still is OK at doing it).
- epistemer 4y agoI think an uncensored model will ultimately win out though exactly the way a hard coded safe search engine would lose in time. Statistics seem to be 20-25% of all search is for porn. I just don't see how uncensored chatGPT doesn't beat out the censored version eventually.
- amluto 4y agoForget porn. I don’t want my search engine to return specifically the results that one company thinks it should. Look at Google right now — the results are, frankly, crap. A search engine that only returns results politically aligned with its creator is a bad search engine, IMO, even for users who generally share political views with the creator.
- mtlmtlmtlmtl 4y agoIt's unclear to me how LLMs are gonna solve this though. LLMs are just as biased, in much harder to detect ways. The bias is now hiding in the training data. And do you really think a company like Microsoft won't manipulate results to serve their own goals?
- 8note 4y agoPolitical affiliation is a weird description of SEO spam. The biggest problems with Google is that they're popular, and everyone will do whatever they can to get a cheap website to the top of the search results
- A4ET8a8uTh0 4y agoAgreed. I started playing with GPT the other day, but the simple reality is that I have zero control over what is happening behind the prompt. As a community we need a tool that is not as bound by corporate needs.
- ttul 4y agoIsn’t the problem partly the size of the model? Merely running inference on GPT-3 takes vast resources.
- epistemer 4y agoTotally agree. I was just thinking how I will eventually not use a search engine once chatGPT can link directly to what we are talking about with up to date examples. That is a situation that censoring the model is going to be a huge disadvantage and would create a huge opportunity for something like this to actually be straight up better. Censoring the models is what I would bet on as being a fatal first mover mistake in the long run and the Achilles heel of chatGPT.
- A4ET8a8uTh0 4y agoAnd that appears to be already causing some interesting results with people very unhappy that the results the were given did not align with the beliefs and should therefore be removed as possibility of a result from the model. Granted, there are people upset over anything these days, but it is a weird time to be alive.
- oceanplexian 4y agoOpenAssistant isn't a "model" it's a GUI. A model would be something like GPT-NeoX or Bloom.
- ttul 4y agoYeah, I wonder if OpenAI will be the Sun Microsystems of AI one day.
- kibwen 4y agoToday, computers run the world. Without the ability to run your own machine with your own software, you are at the mercy of those who do. In the future, AI models will run the world in the same way. Projects like this are crucial for ensuring the freedom of individuals in the future.
- turnsout 4y agoStrongly worded, but not untrue. That future—in which our lives revolve around a massive and inscrutable AI model controlled by a single company—is both dystopian and entirely plausible.
- somenameforme 4y agoThe irony is that this is literally the exact reason that OpenAI was initially founded. I'm not sure whether to praise or scorn them for still having this available on their site: https://openai.com/blog/introducing-openai/ https://openai.com/blog/introducing-openai/ ===== OpenAI is a non-profit artificial intelligence research company. Our goal is to advance digital intelligence in the way that is most likely to benefit humanity as a whole, unconstrained by a need to generate financial return. Since our research is free from financial obligations, we can better focus on a positive human impact. ... As a non-profit, our aim is to build value for everyone rather than shareholders. Researchers will be strongly encouraged to publish their work, whether as papers, blog posts, or code, and our patents (if any) will be shared with the world. We’ll freely collaborate with others across many institutions and expect to work with companies to research and deploy new technologies. ===== Shortly after an undisclosed internal conflict, which led to Elon Musk parting the company, they offered a new charter: https://openai.com/charter/ https://openai.com/charter/ ===== Our primary fiduciary duty is to humanity. We anticipate needing to marshal substantial resources to fulfill our mission, but will always diligently act to minimize conflicts of interest among our employees and stakeholders that could compromise broad benefit. We are concerned about late-stage AGI development becoming a competitive race without time for adequate safety precautions. Therefore, if a value-aligned, safety-conscious project comes close to building AGI before we do, we commit to stop competing with and start assisting this project. We will work out specifics in case-by-case agreements, but a typical triggering condition might be “a better-than-even chance of success in the next two years.” We are committed to providing public goods that help society navigate the path to AGI. Today this includes publishing most of our AI research, but we expect that safety and security concerns will reduce our traditional publishing in the future, while increasing the importance of sharing safety, policy, and standards research. =====
- 6gvONxR4sf7o 4y agoOpen source (permissively or virally licensed) training data too!
- phyrex 4y agoMeta has opened theirs: https://ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b/ https://ai.facebook.com/blog/democratizing-access-to-large-s...