10 ms·
OpenJourney: Midjourney, but Open Source
- nickthegreek 4y agoThis is just a sd checkpoint trained on output of Midjourney. You can load it into a1111 or invokeai for easier usage. If you are looking for new checkpoints, check out the Protogen series though for some really neat stuff.
- rahimnathwani 4y agoDo you mean this one? https://huggingface.co/darkstorm2150/Protogen_Infinity_Official_Release https://huggingface.co/darkstorm2150/Protogen_Infinity_Offic... On the same topic, is there some sort of 'awesome list' of finetuned SD models? (something better than just browsing https://huggingface.co/models?other=stable-diffusion https://huggingface.co/models?other=stable-diffusion)
- liuliu 4y agohttps://civitai.com/ https://civitai.com/
- nickthegreek 4y agoNot sure why this is downvoted. Civitai does in fact list a bunch of fine tuned models and can be sorted by highest ranked, liked, downloaded, etc. It is a good resource. Many of the models are also available in the .safetensor format so you dont have to worry about a pickled checkpoint.
- lancesells 4y agoI didn't downvote but I have to say the images shown on that page are hilariously juvenile. I was a teenager once so I get it but I'm guessing the content is where the downvotes are coming from?
- CyanBird 4y ago"The internet is for Porn! The internet is for Porn! So grab your dick and double click! For Porn! Porn! Porn!" Apologies for the bad taste, but I simply love that song, an absolute classic https://youtu.be/j6eFNRKEROw https://youtu.be/j6eFNRKEROw Anyhow, regarding civai, you can filter out the NSFW models quite easily Ought be noted that protogen 5.3 even when it is not an explicit porn model, it was trained with explicit models... So it can be... Raucy as well
- narrator 4y agoLooking at this site, I would argue that the canonical "hello world" of an image diffusion model is a picture of a pretty woman. The canonical "hello world" for community chatbots that can run on a consumer GPU will undoubtedly be an AI girlfriend.
- alephaleph 4y agoLena all over again
- rahimnathwani 4y agoThanks. BTW I love your app! At my desk I use Automatic1111 (because I have a decent GPU), but it's so nice to have a lean back experience on my iPad. Also, even my 6yo son can use it, as he doesn't need to manipulate a mouse.
- dr_dshiv 4y agoWow. Is there something like this for text models?
- madeofpalk 4y agowhy are they all big breasted women?
- nickthegreek 4y agoHere are the protogen models https://civitai.com/user/darkstorm2150 https://civitai.com/user/darkstorm2150
- Eduard 4y agoI didn't understand a single word you said :D
- lxe 4y agosd checkpoint -- stable diffusion checkpoint. a model weights file that was obtained by tuning the stablediffusion weights file using probably something like dreambooth on some number of midjourney-generated images. a1111 / invokeai -- stable diffusion UI tools Protogen series -- popular stablediffusion checkpoints you can download so you can generate content in various styles
- quitit 4y agoIt's actually worse, because automatic and invoke will let you chain up GANs to fix faces and the like, and both have trivial installation procedures. This offering is like going back to August 2022.
- 152334H 4y agoHN is just incredibly bad at figuring out what kind of ML projects are worth getting excited about and what aren't. MJ v4 doesn't even use Stable Diffusion as a base [0]; a fine-tune of the latter will never come close to achieving what they do. [0] - https://discord.com/channels/729741769192767510/730095596861521970/1038576626377707590 https://discord.com/channels/729741769192767510/730095596861...
- kossTKR 4y agoIt doesn’t use stablediffusion? I thought everything besides dall-e was sd under the hood.
- tsurba 4y agoMj earlier versions were around before SD came out. Before dall-e 2 too, but after 1 IIRC. So I assume they have their own custom setup. Perhaps based on dall-e 1 paper originally (not weights as they were never published) and improved from there.
- kossTKR 4y agoInteresting i thought stable diffusion was the only other "big player" besides OpenAI because of the expenses in training and extrapolating from papers / new research. Is Midjourney heavily funded? Because if they can battle SD why aren't we seeing lots of people doing the same, even in the Open Source space?
- pdntspa 4y agoI just gave Protogen a spin and the diversity of outputs it gave me was abysmal. Every seed for the same (relatively open-ended) prompt used the same color scheme, had the same framing, and the same composition. Whereas with SD 1.5/2.1, the subject would be placed differently in-frame, color schemes were far more varied, and results were far more interesting compositionally. (This is with identical settings between the two models and a random seed) So unless you want cliche-as-fuck fantasy and samey waifu material, classic SD seems to do a much better job.
- vintermann 4y agoYes, protogen is based on merging of checkpoints. The checkpoints it's merged from are also mostly based on merging. Tracing the degree of ancestry back to fine tuned models is hard, but there's a ton of booru-tagged anime and porn in there. If there's one style I dislike more than the bland Midjourney style, it's the super-smooth "realistic" child faces on adult bodies that protogen (and its own many descendants) spit out.
- throwaway64643 4y ago> This is just a sd checkpoint trained on output of Midjourney Which is sub-optimal -> bad. You don't want to train on output from an AI because you'll end up with a worse version of whatever that AI is already being bad at (hands, foot, and countless other things). This is the AI feedback loop that people have been talking about. So instead of figuring out what Midjourney has done to get such good result, people just blatantly straight copied those results and fed them directly into the AI, as true as the art thief stereotype they are.
- vjbknjjvugi 4y agowhy does this need write permissions on my hf account?
- deathtrader666 4y ago"For using OpenJourney you have to make an account in huggingface and make a token with write permission."
- admax88qqq 4y agoBut why
- deleted 4y ago[deleted]
- EamonnMR 4y agoIf it's using a RAIL license isn't it not open source?
- nickvincent 4y agoYeah, that's a fair critique, I think the short answer is depends who you ask. See this FAQ here: https://www.licenses.ai/faq-2 https://www.licenses.ai/faq-2 Specifically: Q: "Are OpenRAILs considered open source licenses according to the Open Source Definition? NO." A: "THESE ARE NOT OPEN SOURCE LICENSES, based on the definition used by Open Source Initiative, because it has some restrictions on the use of the licensed AI artifact. That said, we consider OpenRAIL licenses to be “open”. OpenRAIL enables reuse, distribution, commercialization, and adaptation as long as the artifact is not being applied for use-cases that have been restricted. Our main aim is not to evangelize what is open and what is not but rather to focus on the intersection between open and responsible licensing." FWIW, there's a lot of active discussion in this space, and it could be the case that e.g. communities settle on releasing code under OSI-approved licenses and models/artifacts under lowercase "open" but use-restricted licenses.
- skybrian 4y agoFair enough. "Source available" would be better than "open source" in this case, to avoid misleading people. (You do want them to read the terms.)
- JoshTriplett 4y agoYeah, this should not have a headline of "open source". Really disappointing that this isn't actually open, or even particularly close to being open.
- daveloyall 4y agoI'm not familiar with machine learning. But, I'm familiar with poking around in source code repos! I found this https://huggingface.co/openjourney/openjourney/blob/main/text_encoder/pytorch_model.bin https://huggingface.co/openjourney/openjourney/blob/main/tex... . It's a giant binary file. A big binary blob. (The format of the blob is python's "pickle" format: a binary serialization of an in-memory object, used to store an in-memory object and later load it, perhaps on a different machine.) But, I did not find any source code for generating that file. Am I missing something? Shouldn't there at least be a list of input images, etc and some script that uses them to train the model?
- KaoruAoiShiho 4y agoHow is it equivalent, it's not nearly as good. Some transparency about how close it is to MJ would be nice though, because it can still be useful.
- 88stacks 4y agoI was about to integrate this into https://88stacks.com https://88stacks.com but it requires a write token to hugging face which makes no sense. It’s a model that you download. Why does it need write access to hugging Face!?!
- bootloop 4y agoDoes it really, have you tried it or do you mean because of the documentation? Just skimmed through the code, haven't really seen anything related to uploading. Might not even be required.
- titaniumtown 4y agoSomeone should do this but for chatGPT. massive undertaking though Edit: https://github.com/LAION-AI/Open-Assistant https://github.com/LAION-AI/Open-Assistant
- vnjxk 4y agolook up "open assistant"
- titaniumtown 4y agooh damn https://github.com/LAION-AI/Open-Assistant https://github.com/LAION-AI/Open-Assistant cool stuff, thanks
- indigodaddy 4y agoLooks like I can’t use this on M1/2?
- liuliu 4y agoThis is just openjourney model fine-tuned with Dreambooth. You can use any of these tools: Draw Things, Mochi Diffusion, DiffusionBee, AUTOMATIC1111 UI on M1 / M2 with this model. (I wrote Draw Things).
- rks404 4y agonoob question - how hard is it to setup and run this on a windows machine? I've had bad luck with python and package management in windows in the past but that was a long time ago.
- andybak 4y agoYeah - it's a real pain (and I'm a Python dev) I just use https://softology.pro/tutorials/tensorflow/tensorflow.htm https://softology.pro/tutorials/tensorflow/tensorflow.htm - A few manual steps but mainly a well tested installed that does it all for you.
- rks404 4y agothank you, I appreciate the honesty! I checked out the guide, it looks promising and will give it a try for the next system I assemble
- rm999 4y agoIt's gotten much easier in the 24 hours because of this binary release of a popular stable diffusion setup+UI: https://github.com/AUTOMATIC1111/stable-diffusion-webui/releases/tag/v1.0.0-pre https://github.com/AUTOMATIC1111/stable-diffusion-webui/rele... (you still need a Nvidia GPU) Extract the zip file and run the batch file. Find the cptk (checkpoint) file for a model you want. You can find openjourney here: https://huggingface.co/openjourney/openjourney/tree/main https://huggingface.co/openjourney/openjourney/tree/main. Add it to the model directory. Then you just need to go to a web browser and you can use the AUTOMATIC1111 webui. More information here: https://github.com/AUTOMATIC1111/stable-diffusion-webui https://github.com/AUTOMATIC1111/stable-diffusion-webui
- rks404 4y agooh this is so great - thanks!
- jpe90 4y agoIf you use the webui it's a single git clone and an optional file edit to set some CLI flags and that's it. You download models and move them to a directory to use them. Recently they introduced a binary release for people that are unfamiliar with git.
- celestialcheese 4y agoIf anyone wants to try it out without having to build and install the thing - https://replicate.com/prompthero/openjourney https://replicate.com/prompthero/openjourney I've been using openjourney (and MJ/SD) quite a bit, and it does generate "better" with "less" compared to standard v1.5, but it's nowhere close to Midjourney v4. Midjourney is so far ahead in generating "good" images across a wide space of styles and subjects using very little prompting. While SD requires careful negative prompts and extravagant prompting to generate something decent. Very interested in being wrong about this, there's so much happening with SD that it's hard to keep up with what's working best.
- chamwislothe2nd 4y agoEvery midjourney image has the same feeling to it. A bit 1950s sci-fi artist. I guess it's just that it all looks airbrushed? I can't put my finger on it.
- IshKebab 4y agoIt's the science magazine article illustration look.
- brianl047 4y agoSounds great If Midjourney applies this to all their artwork then maybe it alleviates some of the ethical concerns (Midjourney then has a "style" independent of the training data)
- VulgarExigency 4y agoBut the style isn't independent of training data. If you don't feed Midjourney images in that style, it's not going to come up with it independently.
- cwkoss 4y agoYeah, I think Midjourney makes fewer unsuccessful images, but harder to get images that dont match their particular style.
- moneywoes 4y agoIs there a solid comparison of midjourney, stable diffusion, dalle 2
- moffkalast 4y agoI've only tried out stable diffusion to any real extent, but seeing what other people have gotten out of the other two I can easily say it's the least performant of the bunch.
- sdenton4 4y agoI would be hesitant to pass judgement if only playing with one. It's easy to compare the deluge you've picked through to other people's best picked cherries...
- moffkalast 4y agoWell sure, but after hours and hours of messing with params my cherry picked best cases were still lightyears away from the average Midjourney example. Maybe I'm just bad at it ¯\_(ツ)_/¯
- d3ckard 4y agoI actually got better examples running SD on my M1 MBA than from my mid journey trial.
- nagonago 4y ago> Also, you can make a carrier! How you may ask? it is easy. In our time, we have a lot of digital asset marketplaces such as NFT marketplaces that you can sell your items and make a carrier. Never underestimate the power open source software provides. At first I thought this might be a joke site, the poorly written copy reads like a parody. Also, as others have pointed out, this is basically just yet another Stable Diffusion checkpoint.
- notpushkin 4y agoThis particular wording sounds like it could be a poor translation from Russian. Sdelat' karjeru (literally: to make a career) means to make a living doing something, or to succeed in doing some job.
- version_five 4y agoThe huggingface element of these annoys me. Reading the other comments, this is just a stable diffusion checkpoint, so I should be able to download it and not use the diffusers library or whatever other HF stuff. But it's frustrating that it's tied to a for profit ecosystem like this. I suppose pytorch is / was Facebook, but if feels more arms length. I don't have to install and run a facebook cli to use it (nobody get any ideas). You don't need a HF cli, you just need to use git LFS (I believe now part of git) to pull the files off of HF (unfortunately still requiring an account with them). It would be nice to see truly open mirrors for this stuff that don't have to involve any company.
- stainablesteel 4y agoi don't think it's at the point where most individuals can financially support the model training, its a company doing all this because it requires the consolidated funds of a business give it 10 years and this will change
- notpushkin 4y agoMaybe crowdfunding is an option today?
- zargon 4y agoThere was a group that tried to do this recently and Kickstarter shut them down.
- rattt 4y agoYou don't need a HF account to download the checkpoint, can be downloaded straight from the website/browser, direct url: https://huggingface.co/openjourney/openjourney/resolve/main/mdjrny-v4.ckpt https://huggingface.co/openjourney/openjourney/resolve/main/...
- version_five 4y agoIs it possible to download with curl or git lfs (or other "free" command line tool) with no login? I couldn't find a way to do that with the original sd checkpoints.
- sourabh03agr 4y agoLooks good but this works well only for gamey, sci-fi kind of themes. Any suggestions for prompts which can yield interesting flowcharts to explain technical concepts?
- sophrocyne 4y agoHey all - InvokeAI maintainer here. A few folks mentioned us in other comments, so posting a few steps to try out this model locally. Our Repo: https://github.com/invoke-ai/InvokeAI https://github.com/invoke-ai/InvokeAI You will need one of the following: An NVIDIA-based graphics card with 4 GB or more VRAM memory. An Apple computer with an M1 chip. Installation Instructions: https://invoke-ai.github.io/InvokeAI/installation/ https://invoke-ai.github.io/InvokeAI/installation/ Download the model from Huggingface, add it through our Model Mgmt UI, and then start prompting. Discord: https://discord.gg/invokeai-the-stable-diffusion-toolkit-1020123559063990373 https://discord.gg/invokeai-the-stable-diffusion-toolkit-102... Also, will plug we're actively looking for people who want to contribute to our project! Hope you enjoy using the tool.
- FloatArtifact 4y agoAny chance of supporting Intel ark GPUs?
- sophrocyne 4y agoWon't say "never!" - Just seems NVidia has a stranglehold on the AI space w/ CUDA. We're mainly waiting on others in the space (And/or increase investment by Intel/AMD) to offer support more broadly. At this rate, I'd give Apple a likely shot of having better support than them w/ the neural engine & CoreML work they've been releasing.
- d3ckard 4y agoOut of curiosity, will M2s work out of the box?
- sophrocyne 4y agoOught to! There are some enhancements coming down the pipe for Macs w/ CoreML, so while they won't be as fast as having a higher end NVidia, they'll continue to get performance increases, as well.
- shostack 4y agoI'm failing to train a model off of this in the Automatic1111 webui Dreambooth extension. Training on vanilla 1.5 works fine. It throws a bunch of errors I don't have in front of me on my phone. Anyone else have similar issues? I loaded it both from a locally downloaded version of the model as well as from inputting in the huggingface path and my token with write (?!?) permissions. Anyone run into similar issues? Suggestions?
- whitten 4y agoMaybe this is an obvious question but if you generate pictures using any of these tools, can you create the same picture/character/person with different poses, or backgrounds, such as for telling a story, and/or creating a comic book, or would you get a new picture every time, such as for the cover of a magazine ? How reproducible would the pictures be ?
- Narciss 4y agoYes, you can create an AI model based on a few pictures of the “model” (the model can also be AI generated) and then you can generate images of all kinds with that model included. Check out this video from prompt muse as an example: https://youtu.be/XjObqq6we4U https://youtu.be/XjObqq6we4U
- techlatest_net 4y agoSome self promotion. We got Stable Diffusion made available as SaaS on AWS[1] with per minute pricing and the unique thing with our SaaS offering is you can shutdown/restart the SaaS environment yourself . You will get charged on per minute basis only when the environment is running. Also, if you want to try the SaaS for free, feel free to submit a request using our contact-us form [2] The Web interface for SD is based on InvokeAI [3] [1] https://aws.amazon.com/marketplace/pp/prodview-qj2mhlfj7cx42 https://aws.amazon.com/marketplace/pp/prodview-qj2mhlfj7cx42 [2] https://saas.techlatest.net/contactus https://saas.techlatest.net/contactus [3] https://github.com/invoke-ai https://github.com/invoke-ai
- Simon321 4y agoKeep in mind the real Midjourney uses a completely different architecture, this is just a checkpoint for stable diffusion.
- vintermann 4y agoWho knows what Midjourney uses. We've got only claims in discords to go by. My guess is they do internally a slightly more careful and less porn/anime oriented version of what the 4chan/protogen people do. Make lots of fine tuned checkpoints, merge them, fine tune on a selection of outputs from that, merge more, throw away most of it, try again etc. Maybe there are other models in the mix, but I wouldn't bet on it.
- haghiri 4y agoThis was my project, but since @prompthero changed their "midjourney-v4 dreambooth" model's name to openjourney, I changed my model name to "Mann-E" which is accessible here: https://huggingface.co/mann-e/mann-e_4_rev-0-1 https://huggingface.co/mann-e/mann-e_4_rev-0-1 (It's only a checkpoint and under development)
- pfd1986 4y agoAre there instructions for fine tuning the model on our own images? Thanks!
- jfdi 4y agoWhat is web4.0?!