5 ms·
The obsession with safety in this announcement feels like a missed marketing opportunity, considering the recent Gemini debacle. Isn’t SD’s primary use case the
by keiferski 3y ago
The obsession with safety in this announcement feels like a missed marketing opportunity, considering the recent Gemini debacle. Isn’t SD’s primary use case the fact that you can install it on your own computer and make what you want to make?
- jsheard 3y agoAt some point they have to actually make money, and I don't see how continuously releasing the fruits of their expensive training for people to run locally on their own computer (or a competing cloud service) for free is going to get them there. They're not running a charity, the walls will have to go up eventually. Likewise with Mistral, you don't get half a billion in funding and a two billion valuation on the assumption that you'll keep giving the product away for free forever.
- keiferski 3y agoBut there are plenty of other business models available for open source projects. I use Midjourney a lot and (based on the images in the article) it’s leaps and bounds beyond SD. Not sure why I would switch if they are both locked down.
- Auracle 3y agoSD would probably be a lot better if they didn't have to make sure it worked on consumer GPUs. Maybe this announcement is a step towards that where the best model will only be able to be accessed by most using a paid service.
- raxxorraxor 3y agoI believe the opposite. I think the ability for people to adopt models made SD more successful than any other model for image synthesis in the first place. Similarly how consumer PCs drove innovation towards faster hardware. I believe it to be the reference of image synthesis for that matter, so "better" is a bit blurry.
- bee_rider 3y agoIs it possible to fine-tune Midjourney or produce a LORA?
- keiferski 3y agoSorry I don’t know what that means, but a quick google shows some results about it.
- elbear 3y agoFinetune means to do extra training on the model with your own dataset, for example to teach it to produce images in a certain style.
- nickthegreek 3y agoNo. You can provide a photos to merge though.
- raxxorraxor 3y agoStable Diffusion has a much deeper learning curve but can generate far more accurate images fitting your perhaps special use case. Although I don't understand the criticism of the images in question. Without a prompt comparison, it is impossible to compare image synthesis. What are examples of images that are beyond these?
- keiferski 3y agoI haven’t used SD so maybe the images on their home page here aren’t representative. But they look very generic and boring to me. They seem to lack “style” in a general aesthetic sense. I am using Midjourney to basically create images in particular artistic styles (e.g., “painting of coffee cup in ukiyo-e style”) and that works very well. I am interested in SD for creating images based on artwork that isn’t indexed by Midjourney, though, as some of the more obscure artists aren’t available.
- raxxorraxor 3y agoUsually there are models adapted to a specific theme since generic models at some point hit barriers. To get an idea, you could look up examples on sites like civitai.com. Of course such sites are heavily biased towards content that is popular, but you will also find quite specific models if you search for certain styles.
- archerx 3y agoIronically their over sensitive nsfw image detector in their api caused me to stop using it and run it locally instead. I was using it to render animations of hundreds of frames but when every 20th to 30th image comes out blurry it ruins the whole animation and it would double the cost or more to rerender it with a different seed hoping to not trigger the over zealous blurring. I don’t mind that they don’t want to let you generate nsfw images but their detector is hopelessly broken, it once censored a cube, yes a cube...
- Sharlin 3y agoUnfortunately their financial and reputational incentives are firmly aligned with preventing false negatives at the cost of a lot of false positives.
- archerx 3y agoUnfortunately I don't want to pay for hundreds if not thousands of images I have to throw away because it decided some random innocent element is offensive and blurs the entire image. Here is the red cube it censored because my innocent eyes wouldn't be able to handle it; https://archerx.com/censoredcube.png https://archerx.com/censoredcube.png What they are achieving with the over zealous safety issues are driving developers to on demand GPU hosts that will let them host their own models, which also opens up a lot more freedom. I wanted to use the stability AI api as my main source for Stable Diffusion but they make it really really hard especially if you want use it as part of your business.
- Sharlin 3y agoI agree that given the status quo, it's a no-brainer to host your own model rather than use their SaaS – and likely one of the main reasons SAI doesn't seem to be on a very stable (heh) footing financially. To put it mildly.
- TehCorwiz 3y agoEveryone always talks about Platonic Solids but never Romantic Solids. /s
- causal 3y agoOpen source models can be fine-tuned by the community if needed. I would much rather have this than a company releasing models this size into the wild without any safety checks whatsoever.
- hypocrticalCons 3y ago[flagged]
- srid 3y agoCould you list the concrete "safety checks" that you think prevents real-world harm? What particular image that you think a random human will ask the AI to generate, which then leads to concrete harm in the real world?
- politician 3y agoNot even the large companies will explain with precision their implementation of safety. Until then, we must view this “safety” as both a scapegoat and a vector for social engineering.
- astrange 3y agoCompanies are not going to explain their legal risks in their marketing material.
- causal 3y agoIf 1 in 1,000 generations will randomly produce memorized CSAM that slipped into the training set then yeah, it's pretty damn unsafe to use. Producing memorized images has precedent[0]. Is it unlikely? Sure, but worth validating. [0] https://arxiv.org/abs/2301.13188 https://arxiv.org/abs/2301.13188
- srid 3y agoOkay, by "safety checks" you meant the already unlawful things like CSAM, but not politically-overloaded beliefs like "diversity"? The latter is what the comment[1] you were replying to was referring to (viz. "considering the recent Gemini debacle"[2]). [1] https://news.ycombinator.com/item?id=39466991 https://news.ycombinator.com/item?id=39466991 [2] https://news.ycombinator.com/item?id=39456577 https://news.ycombinator.com/item?id=39456577
- bluescrn 3y agoBefore long we're going to need a new word for physical 'safety' - when dealing with heavy machinery, chemicals, high voltages, etc.
- jiggawatts 3y agoJust replace “safety” with “puritan” in all of these announcements and they’ll make more sense.
- AnthonyMouse 3y ago> the recent Gemini debacle. I've noticed that SDXL does something a little odd. For a given prompt it essentially decides what race the subject should be without the prompt having specified one. You generate 20 images with 20 different seeds but the same prompt and they're typically all the same race. In some cases they even appear to be the same "person" even though I doubt it's a real person (at least not anyone I could recognize as a known public figure any of the times it did this). I'm kind of curious what they changed from SD 1.5, which didn't do this.
- atleastoptimal 3y agoAGI will be safe and you will be happy. And safe doesn't mean "lower than 1/10^6 chance of ending humanity", safe means shoddily implemented curtailing to idpol + fundamentalist level moral aversion towards human sexuality
- selfmodruntime 3y agoRight. For a group of hardliners of the left political spectrum they are weirdly against depictions of sex.
- atleastoptimal 3y agoIt's not really their feelings, it's about controversy, bad publicity, etc. It's too delicate right now to risk people using their models for sex stuff.
- FireInsight 3y agoI don't believe corporations implementing liberal politics to prevent backlash and it being legislated onto them qualifies as them being on the "left political spectrum".
- selfmodruntime 3y agoSome backlash is perfectly ignorable. The twitter mob will move onto the next thing in a few days. And the proliferation of turned-to-the-max DEI employee policies, inclusion committees and self-censored newspeak does come from the californic technobubble cesspit. There is such a great liberal fear of being perceived as any of the negative -ists and -isms that the pendulum swings to the other extreme where the left horseshoe toe meets its rightmost brother, which is why SD and Google's new toy rewrite ancient European history to include POC's and queer people.
- SixDouble5321 3y agoI am not sure you are a good fit for the internet. Keep your bigotry at home.