23 ms·
Easy Stable Diffusion XL in your device, offline
- tatrajim 3y agoWorks beautifully on my macbook m3 with 128gb.
- ukuina 3y agoThat's quite a luxurious config!
- api 3y agoGuernika is a decent one for Mac, available in the App Store.
- ProllyInfamous 3y agoThe 16GB (base model) M2 Pro Mini, despite its overall awesomeness (running DiffusionBee.app / etc)... does not meet Minimum System Requirements (Apple Silicon requires 32GB RAM). So now I have to contemplate shopping for a new mac TWICE in one year (never happened before).
- sophrocyne 3y agohttps://github.com/invoke-ai/InvokeAI https://github.com/invoke-ai/InvokeAI - runs on Mac silicon, can squeeze out SDXL images on a 16gb mac with SSD-1B or Turbo models.
- ProllyInfamous 3y agoThank you for this link.
- wsgeorge 3y agoCurrently using SDXL (through Huggingface Diffusers) on an M1 16GB Mac. Takes on average 4-5mins to generate an image. It's usable.
- ttul 3y agoGood lord. I can get a 2048x2048 upscaled output from a very complex ComfyUI workflow on a 4090 in 15 seconds. This includes three IPAdapter nodes, a sampling stage, a three-stage iterative latent upscaler, and multiple ControlNets. Macs are not close to competitive for inference yet.
- rsynnott 3y agoI mean, a 4090 would appear to cost $2000, and came out a year ago; it has about 70bn transistors. The M1 could be had for $700 for a desktop, $1000 as part of a laptop, came out three years ago, and has 16bn transistors, some of which are CPU. An M3 Ultra might be a more reasonable comparison for the 4090.
- michaelt 3y ago24GB cards weren't always $2000. I've seen people on this very forum [1] who brought two 3090s for just $600 each. Agree the prices are crazy right now, though. [1] https://news.ycombinator.com/item?id=37438847 https://news.ycombinator.com/item?id=37438847
- ttul 3y agoA very fair comment. I use an M2 MBP with max specs. It’s very powerful, but the Nvidia card draws a whole lot more power…
- myself248 3y agoWhen choosing a machine with non-expandable RAM, you went with the minimum configuration? That's a choice, I suppose, but the outcome wasn't exactly hard to foresee.
- ProllyInfamous 3y agoAt the time, it seemed that ANY upgrade made the M2Pro mini cost-inaffective. One of my coller Q12023 ChatGPT experiences was having it help me "reason through" which machine was most "upgrade-proof," dollar-for-dollar. Now in Q42023, I would definitely had made the decision to purchase an M2 Studio (base model) instead — those additional upgrades (VS M2Pro mini config, sim.) were much more cost-effective. Overall, I'm extremely satisfied with my M2Pro base model.
- sophrocyne 3y agoThere are already a number of local, inference options that are (crucially) open-source, with more robust feature sets. And if the defense here is "but Auto1111 and Comfy don't have as user-friendly a UI", that's also already covered. https://github.com/invoke-ai/InvokeAI https://github.com/invoke-ai/InvokeAI
- GaggiX 3y agoAlso just Krita with the diffusion AI plugin: https://github.com/Acly/krita-ai-diffusion https://github.com/Acly/krita-ai-diffusion
- blehn 3y agoNo idea whether or not the UI is user-friendly, but the installation steps alone for InvokeAI are already a barrier for 99.9% of the world. Not to say Noiselith couldn't be open-source, but it's clearly offering something different from InvokeAI.
- demosthanos 3y agoI can't even figure out how one would install Noiselith. It has some text that says "Download for free on your PC", but it's not a button or a link. Maybe they're doing some weirdly locked-down user-agent sniffing and refuse to allow me to even attempt to download any version on Linux? InvokeAI is installed via a script, sure, but it's also just a few clicks: download, extract, double-click on a specific file, enjoy.
- blehn 3y agoThere are two giant download buttons on the Noiselith homepage. The mac button downloads a dmg and the windows button downloads an exe.
- internet101010 3y agoI switched to InvokeAI and won't go back to basic a1111 webui. I like how everything is laid out, there are workflow features, you can easily recall all properties (prompt, model, lora, etc.) used to generate an image, things can be organized into boards, and all off the boards/images/metadata are stored in a very well-designed sqlite database that can be tapped into via DataGrip.
- Auracle 3y agoI realize it may be good marketing, but it's odd to have the fact that it's on device and offline be the primary differentiator when that's probably how most people use Stable Diffusion already. I'd probably focus more on it being easy to install and use, as that's something that isn't done much. For me, if it doesn't have Controlnet, upscaling, some kind of face detailer, and preferably regional prompting, I'm out. I also kind of wish all of these people that want to make their own SD generators would instead work on one of the open source ones that already exist. While an app store might be a good idea, in a world with Auto111 and all of their extensions I think it's going to go over poorly with the Stable Diffusion community, for what it's worth.
- michaelt 3y agoI think there's probably a bunch of people who don't use things like A1111 because of the complexities of the download-this-which-downloads-this-which-downloads-this-then-you-manually-download-this-and-this setup model. I can see how something simpler might appeal to new users, even if it doesn't appeal to existing users.
- Auracle 3y agoSure, and I agree with that. As I said, I'd probably push that just as much as it being 'offline,' if not more.
- deleted 3y ago[deleted]
- philipov 3y agoYou hit the nail on the head when you said it's good marketing, but go all the way. The thing you find odd tells you who they want to use their product; You're not their target audience. They are trying to convert people from using online-only services like Dall-E, not people who already use SD.
- prepend 3y agoI’ve oddly found many cloud wrappers to stable diffusion. So I like the upfront on device/offline description. It was weird when I was first playing with SD how many packages did severe phone home or vms or whatever instead of just downloading a bunch of stuff and running it.
- alienreborn 3y agoInteresting, will check it out to see how it compares with https://diffusionbee.com https://diffusionbee.com which I am using for last few months for fun.
- janmo 3y agoI just checked out both and Noiselith produces much, much better results.
- rgbrgb 3y agoJust installed, this is very cool. Local AI is the future I want (and what I'm working on too). A few notes using it... Pros: - seems pretty self contained - built in model installer works really well and helps you download anything from CivitAI (I installed https://civitai.com/models/183354/sdxl-ms-paint-portraits https://civitai.com/models/183354/sdxl-ms-paint-portraits) - image generation is high quality and stable - shows intermediate steps during generation Cons: - downloads 6.94GB SDXL model file somewhere without asking or showing location/size. Just figured out you can find/modify the location in the settings. - very slow on first generation as it loads the model, no record of how long generations take but I'd guess a couple minutes (m1 max macbook, 64GB) - multiple user feedback modules (bottom left is very intrusive chat thing I'll never use + top right call for beta feedback) - not open source like competitors - runs 7 processes, idling at ~1GB RAM usage - non-native UX on macOS, missing hotkeys you'd expect, help menu. electron app? Overall 4/5 stars, would open again :)
- liuliu 3y agoYou should check out Draw Things on macOS. It works well enough for SDXL on 8GiB macOS devices.
- miles 3y agoAre you the developer by any chance? If so, it would be helpful to state it.
- liuliu 3y agoI am. I thought this is obvious. My statement is objective. I would go as far as: it is the only app works at 8GiB macOS devices with SDXL-family models.
- adamjc 3y agoHow would that be obvious to anyone?
- cellularmitosis 3y ago
- amelius 3y agoSo it's free, but not open source. What is the catch?
- sib 3y agoThey will have a non-free (as in beer) version once they exit beta (per the website).
- SV_BubbleTime 3y agoWith no real way to confirm it doesn’t phone home. IDK, this all seems weird considering there are four other really good projects that do all of these things already.
- stjohnswarts 3y agowhat? there are dozens of application level firewalls out there
- tracerbulletx 3y agoAll the real homies use ComfyUI
- weakfish 3y agoElaborate?
- tracerbulletx 3y agoI'm being kind of tongue in cheek because I understand that this is for just making things really easy and ComfyUI is a node based editor that most people would have trouble with. But the best UI for local SD generation that the community is using is https://github.com/comfyanonymous/ComfyUI https://github.com/comfyanonymous/ComfyUI
- rish 3y agoAgreed. It's worth the learning curve for the sheer power you can enable your workflows. I've always wanted to toy around with node based architectures and this seemed quite easy after using A1111 extensively. The community providing ready to go workflows has made it quite enjoyable too.
- SV_BubbleTime 3y agoI can’t seem to get myself to switch. I’ve only used A1111 a dozen times and only for funny work images… I can’t seem to get myself to switch over to comfy because it looks rather intimidating.
- rish 3y agoI mean A1111 is great if you are a casual user as it has everything ready at your fingertips. When you want to apply advanced workflows and repetitive tasks or use something cutting edge then Comfy is handy. Another A1111 alternative to try which focuses on prompt generation is: https://github.com/lllyasviel/Fooocus https://github.com/lllyasviel/Fooocus
- verdverm 3y agoThis is when I feel the 24G mem limit of the mac book/air
- brucethemoose2 3y agoI would highly recommend Fooocus to anyone who hasn't tried: https://github.com/lllyasviel/Fooocus https://github.com/lllyasviel/Fooocus There are a bajillion local SD pipelines, but this one is, by far, the one with the highest quality output out-of-the-box, with short prompts. Its remarkable. And thats because it integrates a bajillion SDXL augmentations that other UIs do not implement or enable by default. I've been using stable diffusion since 1.5 came out, and even having followed the space extensively, setting up an equivalent pipeline in ComfyUI (much less diffusers) would be a pain. Its like a "greatest hits and best defaults" for SDXL.
- liuliu 3y agoYeah, Fooocus is much better if you are going for the best local generated result. Lvmin puts all his energy into making beautiful pictures. Also it is GPL licensed, which is a + in my book.
- stoobs 3y agoEh, I messed around with it for a while - it's okay and good for beginners, but without much more effort you can get better results out of A1111 or ComfyUI
- rvz 3y agoLooks like a complete contraption to setup and looks very unpleasant to use at first glance when compared against Noiselith. The hundreds of python scripts and having the user to touch the terminal shows why something like Noiselith should exist for normal users rather than developers or programmers. I would rather take a packaged solution that just works over a bunch of scripts requiring a terminal.
- liuliu 3y agoYou have to make trade-off in software development. Fooocus trades on the best picture rather than the most beautiful interface, and also simplicity in its use. I think it is a good trade-off given the technology is improving at breaking-neck speed. Look, DiffusionBee is still maintained but still no SDXL support. Anyone who bet that the technology is done and it is time to focus on the UI is making the wrong bet.
- LorenDB 3y agoWhy do we never see AMD support in these projects?
- stuckkeys 3y agoI think it is a matter of why AMD does not support these projects. NVIDIA is involved everywhere. They could easy do the same. At least to what I have observed on the internetz.
- mg 3y agoWould it be possible to run Stable Diffusion in the browser via WebGPU?
- skocznymroczny 3y agohttps://websd.mlc.ai/#text-to-image-generation-demo https://websd.mlc.ai/#text-to-image-generation-demo
- stuckkeys 3y agoInstalled it. Ran it. Generated. Slow for some reason. Deleted it. Looks similar to Pinokio, and that is opensource.
- dreadlordbone 3y agoAfter installation, it wouldn't run on my Windows machine unless I granted public and private network access. Kinda tripped up since it says "offlilne".
- kemotep 3y agoIf you disconnected completely from the internet did it still run? That is completely wrong to advertise it as “offline” if it requires an active internet connection to run.
- tredre3 3y agoI had a similar experience. On the first run it downloads about 30GB of data. I don't know if it would work offline on subsequent runs because for me it never ran again without crashing! Also upon uninstallation it left behind all its data (not user data, mind you. But the executable itself, its python venv, its updater, and all the models. Uninstall basically just removed the shortcut in the start menu).
- m3kw9 3y agoDoes not work at all, it needs you to go and find a “model”, like just download it for man.
- solarkraft 3y agoI find it interesting that it requires 16GB of RAM on Windows but 32 on a Mac. Unfortunately that leaves me out ...
- stared 3y agoI keep getting "Failed to generate. Please try again" 10 seconds after model loading. It is hardly helpful, as trying again gives the same error. Apple Silicon M1, 32GB RAM, in any case.
- stets 3y agodefinitely exciting to see more local clients come out. As mentioned in other comments, there are some great ones out already. I've used automatic1111 which is quick and doesn't require a ton of tuning. But it still has lots of knobs and options which makes it difficult initially. Fooocus is super quick but of course less customization. Then there's ComfyUI, the holy grail of complicated, but with that complication comes the ability to do so much. It is a node-based app that allows you to create custom workflows. Once your image is generated, you can pipe that "node" somewhere else and modify it, eg: upscale the image or do other things. I'd like to see if Noiselith or some others offer support for SDXLTurbo -- it came out only a few days ago but in my opinion is a complete game-changer. It can generate 512x512 images in ~half a second on consumer GPUs. The images aren't crazy quality but that ability to make a prompt like "fox in the woods", see it instantly and then add "wearing a hat" and see it instantly generate again is so valuable. Prior to that, I'd wait 12 seconds for an image. Sounds like not a big deal, but the value of being able to iterate so quickly makes local image gen so much more fun.
- evanjrowley 3y agoHow's support for AMD GPUs? I only saw Nvidia listed.
- skocznymroczny 3y agoThe main issue with AMD is that to get reasonable performance you need to use ROCm, and ROCm is only available on Linux. They started porting parts of ROCm to Windows but it's not enough to be usable yet, might be different in few months.
- seydor 3y agobut what s gonna happen to all those AI valuations if we all go offline
- kleiba 3y agoSales prompt: "Young woman with blonde curls in front of a fantasy world background, come hither eyes, sitting with her legs spread, wearing a white shirt and jeans hot pants." I mean, really??
- smcleod 3y agoYeah that’s creepy as.
- momojo 3y agoI'm genuinely curious how many people in the open source community are pouring their sweat and blood into these projects that are, at the end of the day, enabling guys to transform their macbooks into insta-porn-books.
- SV_BubbleTime 3y agoHow many technological revolutions do we need to go through before we just accept an admit by default it’s typically about boobs?
- lost_tourist 3y ago[dead]
- rcoveson 3y agoIf the prompt wasn't somewhat sexual, divisive, or offensive it would be wide open to the chorus of "still not as good as midjourney/dall-e/imagen". Freedom from restriction is one of the main selling points.
- KolmogorovComp 3y agoGlad I’m not the only one who found it inappropriate. Feels very much like a dog whistle.
- rcoveson 3y agoWhat's subtle about it? In the dog whistle analogy, who are they who cannot hear the whistle? To me this is more like yelling "ROVER! COME HERE BOY!" at the top of your lungs.
- NKosmatos 3y agoAs others have stated, Local AI (completely offline after model/weight download) is the way to go. If I have the hardware why shouldn't I be able to run all these fancy software on my own machine? There are many great suggestions and links to other similar/better packages, so follow the comments for more info, thanks :-)
- orliesaurus 3y agoI am running this on my 3070 RTX and 32GB ram Ryzen 5 and this is flawless! Literally the reason why I am coming to HN every day! Thanks devs :)
- saintradon 3y agoVery much enjoying this, but, I BSOD'd very hard after making an image. (Maybe my PSU or GPU is bad, I need to take a look).
- causi 3y agoWhat's the privacy and licensing like for this? I'm honestly too ignorant to know if someone's allowed to use this for commercial purposes, or even if it's sending the generated images/prompts somewhere even if it's rendering locally.
- smcleod 3y agoDoesn't seem to work with SDXL Turbo or SDXL LCM
- starwin1159 3y agoAny prompt keywords website recommended?
- cchance 3y agoHaven't gotten to test it but given i use CoreML on Comfy, i wonder if we'll see more optimizations and performance work on the back end of these platforms as more useful frontends come out. the 1-4it/s on a 512 image is just sad, and the 2-3s/it on 1024 is just sad in this modern day, hell the ANE can't even run SD 1024x1024 images on a Macbook Pro M3 :S
- airesearch69 3y agoi created an AI Modell (have like 20+ very similar face photos of my dream model) created with "Fooocus" Juggernaut XL SDXL)... what is the best way to creat myself an "Modell" or "checkpoint" of my wished modell face? i find tutorials but they seem complicated and outdated. thanks for any small tipp what things to research for actually method. Thanks