5 ms·

This is just a sd checkpoint trained on output of Midjourney. You can load it into a1111 or invokeai for easier usage. If you are looking for new checkpoints,

This is just a sd checkpoint trained on output of Midjourney. You can load it into a1111 or invokeai for easier usage. If you are looking for new checkpoints, check out the Protogen series though for some really neat stuff.

rahimnathwani 4y ago
Do you mean this one? https://huggingface.co/darkstorm2150/Protogen_Infinity_Official_Release https://huggingface.co/darkstorm2150/Protogen_Infinity_Offic... On the same topic, is there some sort of 'awesome list' of finetuned SD models? (something better than just browsing https://huggingface.co/models?other=stable-diffusion https://huggingface.co/models?other=stable-diffusion)
- liuliu 4y ago
  https://civitai.com/ https://civitai.com/
  - nickthegreek 4y ago
    Not sure why this is downvoted. Civitai does in fact list a bunch of fine tuned models and can be sorted by highest ranked, liked, downloaded, etc. It is a good resource. Many of the models are also available in the .safetensor format so you dont have to worry about a pickled checkpoint.
    - lancesells 4y ago
      I didn't downvote but I have to say the images shown on that page are hilariously juvenile. I was a teenager once so I get it but I'm guessing the content is where the downvotes are coming from?
      - CyanBird 4y ago
        "The internet is for Porn! The internet is for Porn! So grab your dick and double click! For Porn! Porn! Porn!" Apologies for the bad taste, but I simply love that song, an absolute classic https://youtu.be/j6eFNRKEROw https://youtu.be/j6eFNRKEROw Anyhow, regarding civai, you can filter out the NSFW models quite easily Ought be noted that protogen 5.3 even when it is not an explicit porn model, it was trained with explicit models... So it can be... Raucy as well
  - narrator 4y ago
    Looking at this site, I would argue that the canonical "hello world" of an image diffusion model is a picture of a pretty woman. The canonical "hello world" for community chatbots that can run on a consumer GPU will undoubtedly be an AI girlfriend.
    - alephaleph 4y ago
      Lena all over again
  - rahimnathwani 4y ago
    Thanks. BTW I love your app! At my desk I use Automatic1111 (because I have a decent GPU), but it's so nice to have a lean back experience on my iPad. Also, even my 6yo son can use it, as he doesn't need to manipulate a mouse.
  - dr_dshiv 4y ago
    Wow. Is there something like this for text models?
  - madeofpalk 4y ago
    why are they all big breasted women?
- nickthegreek 4y ago
  Here are the protogen models https://civitai.com/user/darkstorm2150 https://civitai.com/user/darkstorm2150
Eduard 4y ago
I didn't understand a single word you said :D
- lxe 4y ago
  sd checkpoint -- stable diffusion checkpoint. a model weights file that was obtained by tuning the stablediffusion weights file using probably something like dreambooth on some number of midjourney-generated images. a1111 / invokeai -- stable diffusion UI tools Protogen series -- popular stablediffusion checkpoints you can download so you can generate content in various styles
quitit 4y ago
It's actually worse, because automatic and invoke will let you chain up GANs to fix faces and the like, and both have trivial installation procedures. This offering is like going back to August 2022.
152334H 4y ago
HN is just incredibly bad at figuring out what kind of ML projects are worth getting excited about and what aren't. MJ v4 doesn't even use Stable Diffusion as a base [0]; a fine-tune of the latter will never come close to achieving what they do. [0] - https://discord.com/channels/729741769192767510/730095596861521970/1038576626377707590 https://discord.com/channels/729741769192767510/730095596861...
- kossTKR 4y ago
  It doesn’t use stablediffusion? I thought everything besides dall-e was sd under the hood.
  - tsurba 4y ago
    Mj earlier versions were around before SD came out. Before dall-e 2 too, but after 1 IIRC. So I assume they have their own custom setup. Perhaps based on dall-e 1 paper originally (not weights as they were never published) and improved from there.
    - kossTKR 4y ago
      Interesting i thought stable diffusion was the only other "big player" besides OpenAI because of the expenses in training and extrapolating from papers / new research. Is Midjourney heavily funded? Because if they can battle SD why aren't we seeing lots of people doing the same, even in the Open Source space?
pdntspa 4y ago
I just gave Protogen a spin and the diversity of outputs it gave me was abysmal. Every seed for the same (relatively open-ended) prompt used the same color scheme, had the same framing, and the same composition. Whereas with SD 1.5/2.1, the subject would be placed differently in-frame, color schemes were far more varied, and results were far more interesting compositionally. (This is with identical settings between the two models and a random seed) So unless you want cliche-as-fuck fantasy and samey waifu material, classic SD seems to do a much better job.
- vintermann 4y ago
  Yes, protogen is based on merging of checkpoints. The checkpoints it's merged from are also mostly based on merging. Tracing the degree of ancestry back to fine tuned models is hard, but there's a ton of booru-tagged anime and porn in there. If there's one style I dislike more than the bland Midjourney style, it's the super-smooth "realistic" child faces on adult bodies that protogen (and its own many descendants) spit out.
throwaway64643 4y ago
> This is just a sd checkpoint trained on output of Midjourney Which is sub-optimal -> bad. You don't want to train on output from an AI because you'll end up with a worse version of whatever that AI is already being bad at (hands, foot, and countless other things). This is the AI feedback loop that people have been talking about. So instead of figuring out what Midjourney has done to get such good result, people just blatantly straight copied those results and fed them directly into the AI, as true as the art thief stereotype they are.

rahimnathwani 4y ago

Do you mean this one? https://huggingface.co/darkstorm2150/Protogen_Infinity_Official_Release https://huggingface.co/darkstorm2150/Protogen_Infinity_Offic... On the same topic, is there some sort of 'awesome list' of finetuned SD models? (something better than just browsing https://huggingface.co/models?other=stable-diffusion https://huggingface.co/models?other=stable-diffusion)

liuliu 4y ago
https://civitai.com/ https://civitai.com/
- nickthegreek 4y ago
  Not sure why this is downvoted. Civitai does in fact list a bunch of fine tuned models and can be sorted by highest ranked, liked, downloaded, etc. It is a good resource. Many of the models are also available in the .safetensor format so you dont have to worry about a pickled checkpoint.
  - lancesells 4y ago
    I didn't downvote but I have to say the images shown on that page are hilariously juvenile. I was a teenager once so I get it but I'm guessing the content is where the downvotes are coming from?
    - CyanBird 4y ago
      "The internet is for Porn! The internet is for Porn! So grab your dick and double click! For Porn! Porn! Porn!" Apologies for the bad taste, but I simply love that song, an absolute classic https://youtu.be/j6eFNRKEROw https://youtu.be/j6eFNRKEROw Anyhow, regarding civai, you can filter out the NSFW models quite easily Ought be noted that protogen 5.3 even when it is not an explicit porn model, it was trained with explicit models... So it can be... Raucy as well
- narrator 4y ago
  Looking at this site, I would argue that the canonical "hello world" of an image diffusion model is a picture of a pretty woman. The canonical "hello world" for community chatbots that can run on a consumer GPU will undoubtedly be an AI girlfriend.
  - alephaleph 4y ago
    Lena all over again
- rahimnathwani 4y ago
  Thanks. BTW I love your app! At my desk I use Automatic1111 (because I have a decent GPU), but it's so nice to have a lean back experience on my iPad. Also, even my 6yo son can use it, as he doesn't need to manipulate a mouse.
- dr_dshiv 4y ago
  Wow. Is there something like this for text models?
- madeofpalk 4y ago
  why are they all big breasted women?
nickthegreek 4y ago
Here are the protogen models https://civitai.com/user/darkstorm2150 https://civitai.com/user/darkstorm2150

Eduard 4y ago

I didn't understand a single word you said :D

lxe 4y ago
sd checkpoint -- stable diffusion checkpoint. a model weights file that was obtained by tuning the stablediffusion weights file using probably something like dreambooth on some number of midjourney-generated images. a1111 / invokeai -- stable diffusion UI tools Protogen series -- popular stablediffusion checkpoints you can download so you can generate content in various styles

quitit 4y ago

It's actually worse, because automatic and invoke will let you chain up GANs to fix faces and the like, and both have trivial installation procedures. This offering is like going back to August 2022.

152334H 4y ago

HN is just incredibly bad at figuring out what kind of ML projects are worth getting excited about and what aren't. MJ v4 doesn't even use Stable Diffusion as a base [0]; a fine-tune of the latter will never come close to achieving what they do. [0] - https://discord.com/channels/729741769192767510/730095596861521970/1038576626377707590 https://discord.com/channels/729741769192767510/730095596861...

kossTKR 4y ago
It doesn’t use stablediffusion? I thought everything besides dall-e was sd under the hood.
- tsurba 4y ago
  Mj earlier versions were around before SD came out. Before dall-e 2 too, but after 1 IIRC. So I assume they have their own custom setup. Perhaps based on dall-e 1 paper originally (not weights as they were never published) and improved from there.
  - kossTKR 4y ago
    Interesting i thought stable diffusion was the only other "big player" besides OpenAI because of the expenses in training and extrapolating from papers / new research. Is Midjourney heavily funded? Because if they can battle SD why aren't we seeing lots of people doing the same, even in the Open Source space?

pdntspa 4y ago

I just gave Protogen a spin and the diversity of outputs it gave me was abysmal. Every seed for the same (relatively open-ended) prompt used the same color scheme, had the same framing, and the same composition. Whereas with SD 1.5/2.1, the subject would be placed differently in-frame, color schemes were far more varied, and results were far more interesting compositionally. (This is with identical settings between the two models and a random seed) So unless you want cliche-as-fuck fantasy and samey waifu material, classic SD seems to do a much better job.

vintermann 4y ago
Yes, protogen is based on merging of checkpoints. The checkpoints it's merged from are also mostly based on merging. Tracing the degree of ancestry back to fine tuned models is hard, but there's a ton of booru-tagged anime and porn in there. If there's one style I dislike more than the bland Midjourney style, it's the super-smooth "realistic" child faces on adult bodies that protogen (and its own many descendants) spit out.

throwaway64643 4y ago

> This is just a sd checkpoint trained on output of Midjourney Which is sub-optimal -> bad. You don't want to train on output from an AI because you'll end up with a worse version of whatever that AI is already being bad at (hands, foot, and countless other things). This is the AI feedback loop that people have been talking about. So instead of figuring out what Midjourney has done to get such good result, people just blatantly straight copied those results and fed them directly into the AI, as true as the art thief stereotype they are.