5 ms·

Your experience matches mine. Everything I have asked is usually _horribly_ wrong, and even asking things in a different order makes it completely change its re

Your experience matches mine. Everything I have asked is usually _horribly_ wrong, and even asking things in a different order makes it completely change its responses, even for otherwise binary questions. Even the "snippet" part of a Google search with the same prompt normally contains enough information to contradict it... I'll also note that when there was hype around Stable Diffusion, one of the images shared around was that of an astronaut riding a horse. If you actually run Stable Diffusion with its default tuning and ask for that prompt, you will get 6 images, of which 5 of them are outright disasters (horses with 6 legs and going downhill from there), and then the 6th image, the only one which could possibly pass as a decent result, is the one that everyone shared and reshared and hyped. Usually other prompts give even more terrible results where there are 0 passable images without extensive tuning. Stable Diffusion now is acknowledged to actually be crap --despite the hype-- and I supposedly need to try the next best thing, whatever that is. But I find myself facing the same situation with ChatGPT 3.5, and now with ChatGPT 4, despite the fact there is no "next best thing", and I don't even know how they could even possible try to fix the problem of it being just wrong.

sorokod 4y ago
Kindest thing one could say is that there is massive cherry picking going on which is borderline dishonest.
- shanebellone 4y ago
  "massive cherry picking" I think the coined phrase is "prompt engineering". Side note, where's the eye roll emoji hiding?
  - whateveracct 4y ago
    reminds me of the BTC pivot from "decentralized currency" to "store of value" goalposts
  - BoorishBears 4y ago
    If you understand what an LLM is, chain of thought isn't something you eye roll at.
    - shanebellone 4y ago
      If you understood what an LLM is not, you might..
      - BoorishBears 4y ago
        Right, another low effort deflection into the "It (is/is not) Intelligent" diversion. You can sit in that tarpit and duke it out with fanatics and doomsayers while patting yourself on the back for "real zingers"... or you can just learn to use the tool and extract your own value from it.
        shanebellone 4y ago
        "Right, another low effort deflection into the "It (is/is not) Intelligent" diversion." Straw man. "You can sit in that tarpit and duke it out with fanatics and doomsayers while patting yourself on the back for "real zingers"... or you can just learn to use the tool and extract your own value from it." GPT offers zero value which reflects my position. Though, it does perform some neat tricks.
        BoorishBears 4y ago
        If it's a straw man feel free elaborate on your incomplete commentary with "If you knew what it's not". GPT offers you zero value because you don't know how to use it, so you're limited to cheap tricks.
        shanebellone 4y ago
        "GPT offers you zero value because you don't know how to use it, so you're limited to cheap tricks." GPT offers me zero value because its internal processes are opaque. It's fundamentally unsuitable for business. Personally, I have no use for it either. Its output is inferior to mine.
- mensetmanusman 4y ago
  Even with cherry pickings it’s still amazing a digital ‘plant’ was invented that has any cherries at all.
- modeless 4y ago
  If the cherry picking is less effort than painting a picture from scratch then I wouldn't say it's dishonest.
  - sorokod 4y ago
    It is fine if one says that they tried various prompt tweaks and out of twenty attempts (for example) here is the the best. To present the best prompt/response while not disclosing that it is a result of trial and error is a different thing altogether.
LewisVerstappen 4y ago
okay that’s just because you’re not good at using the models. Obviously you have to play around with them and figure out how to prompt & tune them. Once you do that, you can get pretty amazing results. I make do a bunch of social media graphics and stable diffusion + midjourney has been insanely useful.
- AshamedCaptain 4y ago
  > okay that’s just because you’re not good at using the models. You literally cannot respond with "you are holding it wrong" specially when I'm claiming that even for the popular _example prompts_ SD authors used they had to hand-pick the best random result over a sea of extremely shitty images. And even in the original paper they disclaim it by saying "oh, our model is just bad at limbs". No, it's not just bad at limbs. They just happened to try examples where it could particularly show how terrible it is at limbs (i.e. spider legged horses and the like). But in truth, it's just bad at everything.
  - kyleyeats 4y ago
    This is like throwing your hammer down in frustration over each nail taking more than one swing.
    - ChatGTP 4y ago
      I guess the difference is hammers are logical, simple tools to use with a known use case. They’re fairly hard to use incorrectly, although it does take some practice to use one, I’ll admit.
  - LewisVerstappen 4y ago
    Nope. You literally just tried out one prompt and saw one good image and several bad ones and just shook your fist at the computer and gave up. I'll repeat myself. You have to play around with the models and learn how to use it (just like you have to do for everything) . > But in truth, it's just bad at everything Thousands of people (including myself) have had the complete opposite result and have gotten amazing pictures. You can play around with the finetuning with different models from civitai and get completely different art styles too. Like, this is so dumb I don't even know how to respond lol. You're like some guy who got a computer for the first time and couldn't figure out how to open the web browser, so he just dismissed it as useless.
pmoriarty 4y ago
You should try Midjourney. It is far more likely than SD to give great results on the first try, even when you're not good at writing prompts. Advanced users of both Midjourney and SD can get some stellar results out of them. Some of that is due to trial and error, and going through dozens or hundreds of images to pick the best ones, but being adept at crafting prompts and using other features of the programs plays a big role too. Know your tools.
candyman 4y ago
I agree that the nature of the algorithm allows it to generate false results which would not be acceptable in many domains. But I think there is tremendous potential to improve what you might call the "baseline" of what information and diagnosis is available. There are great doctors out there for sure but in many places there are close to zero doctors, or worse, bad doctors. While it's a very complex domain there are much simpler parts of it. A child with a cancer tumor in their brain is a very different case than someone who has a rash and a headache. There's a great deal of regulation as well that will come into play here so it's going to take a while. I know Google has a whole LLM that is using only healthcare data that they have been working on for a while.
jasondigitized 4y ago
This is the exact opposite experience I have had with code. While it isn’t perfect it’s ability to scaffold code is a huge productivity booster. Example. Tailwind. “How can I highlight a parent container when I hover on any of its children using Tailwind”. JavaScript “How can I merge two JavaScript objects and remove any duplicates”.
- lm28469 4y ago
  Yeah it's very good at answering basic questions which have been answered 50+ times on stack overflow &co that's for sure. I use it for my side projects, for tech I have no experience in, and it works very well, because I know what I want, I know that it is possible and I just need it to vomit the boilerplate to save me 5 google searches For my day job it's next to useless, and if your day job can already be automated by chatgpt I have bad news for you
  - 2devnull 4y ago
    “if your day job can already be automated by chatgpt” If they can automate the work of a physician, who exactly is safe? Low skill labor, maybe, for awhile.
    - meroes 4y ago
      The remote physician misdiagnosed my X-ray last time. That physician is easily automated out and possibly for the benefit of the patients not just costs. The other staff involved, like the NP, X-ray tech, assistant, are fine for a lot longer.
      - 2devnull 4y ago
        “are fine for a lot longer.” My point is that “a longer” implies “when” rather than “if”. Everyone is replaceable, in the long run.
    - lm28469 4y ago
      > If they can automate the work of a physician, who exactly is safe? But they can't, it's like saying you're 15cl stove top italian coffe maker is replacing a starbucks tier coffee machine If the only metric you account for is "it makes coffee" boolean then sure, if you actually implement it you'll notice things falling apart in the first 10 minutes.
smusamashah 4y ago
Agree with GPT but with StableDiffusion you are only partially correct. Visit /r/StableDiffusion to see the stuff people are making. People share prompt, seed, model settings etc and you can reproduce the exact same thing. I do agree that it's bad at following the prompt exactly. It will produce most of the things you mentioned in the prompt but not necessarily in the same fashion you asked for. I don't agree that produced images are mostly shitty, just visit that subreddit.
- Sharlin 4y ago
  > I don't agree that produced images are mostly shitty, just visit that subreddit. SD is definitely very good in the right hands, and it’s a little unfair to expect to be able to get instant good results without any skill. It’s honestly pretty crazy that we now have things like ChatGPT and SD – and people are already calling them crap because they don’t work perfectly and their productive use actually requires some skill! But r/StableDiffusion, or any public gallery, is obviously one giant selection effect. 99.9% of attempts could be crap and the 0.1% would still be enough to fill a subreddit.
  - smusamashah 4y ago
    Sort by new and you will get the idea of crap that people post on a public forum. Default sorting only shows you the popular/better content. To give you a general idea of what percentage can be good images: I recently made a lots of wallpapers to cycle through daily using SD. I found a good prompt, a good model, and let it generate bunch of images continuously for few hours. None of the images were shitty (they were all random seeds), only images I discarded had artifacts I didn't like or couldn't keep my eyes away from. With SD you can't just expect to give a prompt "beautiful landscape" and expect it to give you a beautiful landscape. It won't. You shall get shitty images and might get a few pleasing ones. You must tune your prompt to get good results.
throwaway675309 4y ago
"Stable Diffusion now is acknowledged to actually be crap if you don't take the time to learn how to use it properly." Fixed that for you. If you have very little technical aptitude, patience, and willingness to learn, it would be better for you to stick with some thing a little more newbie friendly such as mid journey. However, loading a proper model such as 526, realistic Vision, or ReV, using control net, and guiding a prompt to where you want it to go while making changes using inpainting/img2img/etc can result in stunning images.

sorokod 4y ago

Kindest thing one could say is that there is massive cherry picking going on which is borderline dishonest.

shanebellone 4y ago
"massive cherry picking" I think the coined phrase is "prompt engineering". Side note, where's the eye roll emoji hiding?
- whateveracct 4y ago
  reminds me of the BTC pivot from "decentralized currency" to "store of value" goalposts
- BoorishBears 4y ago
  If you understand what an LLM is, chain of thought isn't something you eye roll at.
  - shanebellone 4y ago
    If you understood what an LLM is not, you might..
    - BoorishBears 4y ago
      Right, another low effort deflection into the "It (is/is not) Intelligent" diversion. You can sit in that tarpit and duke it out with fanatics and doomsayers while patting yourself on the back for "real zingers"... or you can just learn to use the tool and extract your own value from it.
      - shanebellone 4y ago
        "Right, another low effort deflection into the "It (is/is not) Intelligent" diversion." Straw man. "You can sit in that tarpit and duke it out with fanatics and doomsayers while patting yourself on the back for "real zingers"... or you can just learn to use the tool and extract your own value from it." GPT offers zero value which reflects my position. Though, it does perform some neat tricks.
        BoorishBears 4y ago
        If it's a straw man feel free elaborate on your incomplete commentary with "If you knew what it's not". GPT offers you zero value because you don't know how to use it, so you're limited to cheap tricks.
        shanebellone 4y ago
        "GPT offers you zero value because you don't know how to use it, so you're limited to cheap tricks." GPT offers me zero value because its internal processes are opaque. It's fundamentally unsuitable for business. Personally, I have no use for it either. Its output is inferior to mine.
mensetmanusman 4y ago
Even with cherry pickings it’s still amazing a digital ‘plant’ was invented that has any cherries at all.
modeless 4y ago
If the cherry picking is less effort than painting a picture from scratch then I wouldn't say it's dishonest.
- sorokod 4y ago
  It is fine if one says that they tried various prompt tweaks and out of twenty attempts (for example) here is the the best. To present the best prompt/response while not disclosing that it is a result of trial and error is a different thing altogether.

LewisVerstappen 4y ago

okay that’s just because you’re not good at using the models. Obviously you have to play around with them and figure out how to prompt & tune them. Once you do that, you can get pretty amazing results. I make do a bunch of social media graphics and stable diffusion + midjourney has been insanely useful.

AshamedCaptain 4y ago
> okay that’s just because you’re not good at using the models. You literally cannot respond with "you are holding it wrong" specially when I'm claiming that even for the popular _example prompts_ SD authors used they had to hand-pick the best random result over a sea of extremely shitty images. And even in the original paper they disclaim it by saying "oh, our model is just bad at limbs". No, it's not just bad at limbs. They just happened to try examples where it could particularly show how terrible it is at limbs (i.e. spider legged horses and the like). But in truth, it's just bad at everything.
- kyleyeats 4y ago
  This is like throwing your hammer down in frustration over each nail taking more than one swing.
  - ChatGTP 4y ago
    I guess the difference is hammers are logical, simple tools to use with a known use case. They’re fairly hard to use incorrectly, although it does take some practice to use one, I’ll admit.
- LewisVerstappen 4y ago
  Nope. You literally just tried out one prompt and saw one good image and several bad ones and just shook your fist at the computer and gave up. I'll repeat myself. You have to play around with the models and learn how to use it (just like you have to do for everything) . > But in truth, it's just bad at everything Thousands of people (including myself) have had the complete opposite result and have gotten amazing pictures. You can play around with the finetuning with different models from civitai and get completely different art styles too. Like, this is so dumb I don't even know how to respond lol. You're like some guy who got a computer for the first time and couldn't figure out how to open the web browser, so he just dismissed it as useless.

pmoriarty 4y ago

You should try Midjourney. It is far more likely than SD to give great results on the first try, even when you're not good at writing prompts. Advanced users of both Midjourney and SD can get some stellar results out of them. Some of that is due to trial and error, and going through dozens or hundreds of images to pick the best ones, but being adept at crafting prompts and using other features of the programs plays a big role too. Know your tools.

candyman 4y ago

I agree that the nature of the algorithm allows it to generate false results which would not be acceptable in many domains. But I think there is tremendous potential to improve what you might call the "baseline" of what information and diagnosis is available. There are great doctors out there for sure but in many places there are close to zero doctors, or worse, bad doctors. While it's a very complex domain there are much simpler parts of it. A child with a cancer tumor in their brain is a very different case than someone who has a rash and a headache. There's a great deal of regulation as well that will come into play here so it's going to take a while. I know Google has a whole LLM that is using only healthcare data that they have been working on for a while.

jasondigitized 4y ago

This is the exact opposite experience I have had with code. While it isn’t perfect it’s ability to scaffold code is a huge productivity booster. Example. Tailwind. “How can I highlight a parent container when I hover on any of its children using Tailwind”. JavaScript “How can I merge two JavaScript objects and remove any duplicates”.

lm28469 4y ago
Yeah it's very good at answering basic questions which have been answered 50+ times on stack overflow &co that's for sure. I use it for my side projects, for tech I have no experience in, and it works very well, because I know what I want, I know that it is possible and I just need it to vomit the boilerplate to save me 5 google searches For my day job it's next to useless, and if your day job can already be automated by chatgpt I have bad news for you
- 2devnull 4y ago
  “if your day job can already be automated by chatgpt” If they can automate the work of a physician, who exactly is safe? Low skill labor, maybe, for awhile.
  - meroes 4y ago
    The remote physician misdiagnosed my X-ray last time. That physician is easily automated out and possibly for the benefit of the patients not just costs. The other staff involved, like the NP, X-ray tech, assistant, are fine for a lot longer.
    - 2devnull 4y ago
      “are fine for a lot longer.” My point is that “a longer” implies “when” rather than “if”. Everyone is replaceable, in the long run.
  - lm28469 4y ago
    > If they can automate the work of a physician, who exactly is safe? But they can't, it's like saying you're 15cl stove top italian coffe maker is replacing a starbucks tier coffee machine If the only metric you account for is "it makes coffee" boolean then sure, if you actually implement it you'll notice things falling apart in the first 10 minutes.

smusamashah 4y ago

Agree with GPT but with StableDiffusion you are only partially correct. Visit /r/StableDiffusion to see the stuff people are making. People share prompt, seed, model settings etc and you can reproduce the exact same thing. I do agree that it's bad at following the prompt exactly. It will produce most of the things you mentioned in the prompt but not necessarily in the same fashion you asked for. I don't agree that produced images are mostly shitty, just visit that subreddit.

Sharlin 4y ago
> I don't agree that produced images are mostly shitty, just visit that subreddit. SD is definitely very good in the right hands, and it’s a little unfair to expect to be able to get instant good results without any skill. It’s honestly pretty crazy that we now have things like ChatGPT and SD – and people are already calling them crap because they don’t work perfectly and their productive use actually requires some skill! But r/StableDiffusion, or any public gallery, is obviously one giant selection effect. 99.9% of attempts could be crap and the 0.1% would still be enough to fill a subreddit.
- smusamashah 4y ago
  Sort by new and you will get the idea of crap that people post on a public forum. Default sorting only shows you the popular/better content. To give you a general idea of what percentage can be good images: I recently made a lots of wallpapers to cycle through daily using SD. I found a good prompt, a good model, and let it generate bunch of images continuously for few hours. None of the images were shitty (they were all random seeds), only images I discarded had artifacts I didn't like or couldn't keep my eyes away from. With SD you can't just expect to give a prompt "beautiful landscape" and expect it to give you a beautiful landscape. It won't. You shall get shitty images and might get a few pleasing ones. You must tune your prompt to get good results.

throwaway675309 4y ago

"Stable Diffusion now is acknowledged to actually be crap if you don't take the time to learn how to use it properly." Fixed that for you. If you have very little technical aptitude, patience, and willingness to learn, it would be better for you to stick with some thing a little more newbie friendly such as mid journey. However, loading a proper model such as 526, realistic Vision, or ReV, using control net, and guiding a prompt to where you want it to go while making changes using inpainting/img2img/etc can result in stunning images.