9 ms·
More and more companies that were once devoted to being 'open', or were previously open, are now becoming increasingly closed. I appreciate Stability AI release
by WiSaGaN 3y ago
More and more companies that were once devoted to being 'open', or were previously open, are now becoming increasingly closed. I appreciate Stability AI releases these research papers.
- loudmax 3y agoIt's hard to build a business on "open". I'm not sure what Stability AI's long term direction will be, but I hope they do figure out a way to become profitable while creating these free models.
- sharmajai 3y agoMaybe not everything should be about business.
- TehCorwiz 3y agoI agree, but Y-Combinator literally only exists to squeeze the most bizness out of young smart people. That's why you're not seeing so much agreement.
- phkahler 3y ago>> but Y-Combinator literally only exists to squeeze the most bizness out of young smart people. YC started out with the intent to give young smart people a shot at starting a business. IMHO it has shifted significantly over the years to more what you say. We see ads now seeking a "founding engineer" for YC startups, but it used to be the founders were engineers.
- te_chris 3y agoSqueezed all the alpha out of the idealists now it’s the business guys turn
- bufferoverflow 3y agoIf you agree, do you mind paying a few hundred thousand for my neural net training expenses?
- baq 3y agoMaybe. Paychecks help with not being hungry, though. I’d be happy if my government or EU or whatever offered cash grants for open research and open weights in AI space. The problem is, everyone wants to be a billionaire over there and it’s getting crowded.
- smith7018 3y agoAgreed but this isn't the same as an open source library; it costs A LOT of money to constantly train these models. That money has to come from somewhere, unfortunately.
- TehCorwiz 3y agoYeah. The amount of compute required is pretty high. I wonder, is there enough distributed compute available to bootstrap a truly open model through a system like seti@home or folding@home?
- Filligree 3y agoThe compute exists, but we'd need some conceptual breakthroughs to make DNN training over high-latency internet links make sense.
- pksebben 3y agoForward-Forward looked promising, but then Hinton got the AI-Doomer heebie-jeebies and bailed. Perhaps someone picks up the concept and runs with it - I'd love to myself but I don't have the skillz to build stuff at that depth, yet.
- altruios 3y agoDistributing the training data also opens up vectors of attack. Poisoning or biasing the dataset distributed to the computer needs to be guarded against... but I don't think that's actually possible in a distributed model (in principal?). If the compute is happing off server: then trust is required (which is not {efficiently} enforceable?).
- TehCorwiz 3y agoTrust is kinda a solved problem in distributed computing, The different "@Home" projects and Bitcoin handle this by requiring multiple validations of a block of work for just this reason.
- ben_w 3y agoGreat, but aren't they simultaneously losing money and getting sued?
- mvkel 3y agoThe choice facing many companies that insist on remaining "open" is: Do you want to 1. be right or 2. stay in business This is one of the reasons why OpenAI pivoted to be closed. Not bc of greedy value extractors; because it was the only way to survive.
- mikkom 3y agoThat was basically why openai was founded. Too bad they decided to get greedy :-(
- probablynish 3y agoMost individuals like being able to acquire more goods and services. A lot follows from there
- kelseyfrog 3y agoYou're right, a lot follows from there. But I'm so tired of being a consumer. I just want to be me for a chance. I'm so, so tired.
- probablynish 3y agoDepending on your background and circumstances, there are ways to opt out of the race to a greater/lesser degree. Moving to a cheaper city in your country, or a cheaper country altogether, is one of them. Finding a less stressful way of making less money is another. I don't know you but I hope things work out :)
- kelseyfrog 3y agoThank you, appreciate it. It's just hard being reminded that there's no escape hatch - we've welded them all shut for eternity. Being reduced to choices within a system but the choice horizon never extends to the system itself and won't within my lifetime makes me feel trapped.
- natebc 3y agowell, know that you're not alone in that feeling.
- deleted 3y ago[deleted]
- bufferoverflow 3y agoTraining these big models is very very expensive. If they don't make money, and they run out of their own money, there will be no more SDXL.
- sandworm101 3y ago>> Training these big models is very very expensive. Which is why they are not the future. A big model that can generate a picture about anything in response to any input makes for a great website. It generates lots of press. But it is not a reasonable tool for content generation. If you want to produce content in a specific area or genre, the best results come from a model trained or modified in the area. So the big generalized AI, if you use it, would only be the framework on which you built your specialized tool. Building that specialized tool, such as something dedicated to images of a particular politician, does not require huge amounts of computation. That sort of thing can and is being done by individuals. I am waiting for a tool trained on publicly-accessible mugshots. It wouldn't be a very big project but could yield a tool to generate very believable mugshots of politicians.
- bufferoverflow 3y agoI think it's unreasonable to expect a model for every possible use case. You would need billions of models, if not trillions. Big generalist models are the future.
- michaelt 3y agoMaybe, but in image generation it's also hard to be closed. The big providers are all so terrified they'll produce a deepfake image of obama getting arrested or something, the models are so locked down they only seem capable of producing stock photos.
- sandworm101 3y ago>> The big providers are all so terrified they'll produce a deepfake image of obama getting arrested or something I think the content they are worried about is far darker than an attempt to embarrass a former president.
- greenavocado 3y agoAI-created child sexual abuse images ‘threaten to overwhelm internet’ https://www.theguardian.com/technology/2023/oct/25/ai-created-child-sexual-abuse-images-threaten-overwhelm-internet https://www.theguardian.com/technology/2023/oct/25/ai-create...
- pleasantpeasant 3y agoThe internet wouldn't have become as big as it is, if it wasn't for the internet's open source models. The internet has been taken over by Capitalist and have ruined the internet, in my opinion.
- londons_explore 3y agoBut they used to let you download the model weights to run on your own machine... But stable diffusion 3 is just in 'limited preview' with no public download links. One has to wonder, why the delay?
- cthalupa 3y agoThat's nothing new with Stability. Even 1.5 was "released early" by RunwayML because they felt Stability was taking too long to release the weights instead of just providing them in DreamStudio. Stability will release them in the coming weeks.
- nuz 3y agoBoth SD1.4 and SDXL was in limited preview for a few months before a public release. This has been their normal course of business for about 2 years now (since founding). They just do this to improve the weights via a beta test with less judgemental users before official release.
- Sharlin 3y agoHow is a closed beta anything out of the ordinary? They know they would only get tons of shit flinged at them if they publicly released something beta-quality, even if clearly labeled as such. SD users can be a VERY entitled bunch.
- Filligree 3y agoMoreover, people would start training on the beta model, splitting the ecosystem if it doesn't die entirely. There's nothing good in that timeline.
- caycep 3y agoare they still the commercial affiliate of the CompVis group at Ludwig Maximillian University?
- deleted 3y ago[deleted]