6 ms·
AI model for near-instant image creation on consumer-grade hardware
- Sharlin 2y agoFor those wondering, it's an adversarially distilled SDXL finetune, not a new base model.
- throwaway314155 2y agoThanks! This article is pretty heavy with PR bullshit.
- dcreater 2y agoTypical university/science journalism written by a lay person without sufficient industry knowledge or scientific expertise
- quikoa 2y agoGithub: https://chendaryen.github.io/NitroFusion.github.io/ https://chendaryen.github.io/NitroFusion.github.io/ Paper: https://arxiv.org/html/2412.02030v2 https://arxiv.org/html/2412.02030v2
- betenoire 2y agoHere is the demo https://huggingface.co/spaces/ChenDY/NitroFusion_1step_T2I https://huggingface.co/spaces/ChenDY/NitroFusion_1step_T2I I'm unable to get anything that looks as good as the images in the README, what's the trick for good image prompts?
- speerer 2y agoI always just assume it's the magic of selection bias.
- avereveard 2y agoI get pretty close result with seed 0 paper https://i.imgur.com/l90WYrT.png https://i.imgur.com/l90WYrT.png replication on hf https://i.imgur.com/MqN1Qwc.png https://i.imgur.com/MqN1Qwc.png
- betenoire 2y agothe imgur link is bad, but I hadn't noticed the prompt tucked away in those reference images and that helps. Thanks (I had asked for a rock climber dangling from a rope, eating a banana, and they were wildly nonsensical images)
- deckar01 2y agoI had the same issue, so I pulled in the SDXL refiner. Night and day better even at one step. https://gist.github.com/deckar01/7a8bbda3554d5e7dd6b316185366a4e8 https://gist.github.com/deckar01/7a8bbda3554d5e7dd6b31618536...
- betenoire 2y agothank you!
- wruza 2y agoThe trick is called cherry picking. Mine the seed until you get something demo-worthy.
- nprateem 2y agoThe devil's in the details as always. A "cartoon of a cat eating an icecream on a unicycle" doesn't bring back any of the 6-pawed mutant cats riding a unicycle, etc. Still, impressive speed.
- NikkiA 2y agoIt gave me plenty of cats with 3 front paws though
- iLoveOncall 2y ago> Instant image generation that responds as users type – a first in the field Stable Diffusion Turbo has been able to do this for more than a year, even on my "mere" RTX 3080.
- vidarh 2y agoNotably, fal.ai used to host a demo here[1] that was very impressive at the time. [1] https://fastsdxl.ai/ https://fastsdxl.ai/
- tgsovlerkhgsel 2y agoThe models seem to have gotten to a point where even something I can run locally will give decent results in a reasonable time. What is currently "the best" (both from an output quality and ease of installation perspective) setup to just play with local a) image generation, b) image editing?
- LeoPanthera 2y agoIf you have a Mac, get "Draw Things": https://drawthings.ai/releases/ https://drawthings.ai/releases/ It supports all major models and has a native Mac UI, and as far as I can tell there's nothing faster for generation. The "best" models, and a bunch more, are built-in. The state of the art is FLUX.1, "dev" version for quality, "schnell" version for speed. SDXL is an older, but still good model, and is faster.
- LZ_Khan 2y agoEdit: never mind seems like this recommendation is not the best A1111 is a good place to start. Very beginner friendly UI. You can lookup some templates on Runpod to get started if you don't have a GPU. someone else mentioned a local setup which might be even easier
- BoredPositron 2y agoA1111 is EoL.
- qclibre22 2y agogit clone https://github.com/lllyasviel/stable-diffusion-webui-forge.git https://github.com/lllyasviel/stable-diffusion-webui-forge.g... download models and all vae files for the model, put in right place, run batch file, configure correctly and then gen images using browser.
- cut3 2y agoComfyUI has all the bells and whistles and is node based which is wonderful. In comfyui you can use any of these and more: Flux has been very popular lately. Pony is popular especially for adult content. SDXL is still great as it has lots of folks tweaking it. I chose it to make a comic as it worked well with LoRas trained on my drawings. (article on using it for a comic here https://www.classicepic.com/p/faq-what-are-the-steps-to-make-this https://www.classicepic.com/p/faq-what-are-the-steps-to-make...)
- ajdjspaj 2y agoWhat does consumer-grade mean in this context - is this referring to an M1 MacBook or a tower full of GPUs? I couldn't find in the paper or README.
- whynotmaybe 2y agoOne Nvidia A100. From the paper : > We train using the AdamW [26] optimizer with a batch size of 5 and gradient accumulation over 20 steps on a single NVIDIA A100 GPU So it's "consumer-grade" because it's available to anyone, not just businesses.
- spott 2y agoThat is the training gpu… the inference gpu can be much smaller.
- whynotmaybe 2y agoI stand corrected. Found on Yi-Zhe Song's Linkedin : > Runs on a single NVIDIA 4090 https://www.linkedin.com/feed/update/urn:li:activity:7270141388476825602/ https://www.linkedin.com/feed/update/urn:li:activity:7270141...
- ajdjspaj 2y agoThanks!
- vidarh 2y agoMy favorite test of image models: Drawing of the inside of a cylinder. That's usually bad enough. Then try to specify size, and specify things you want to place inside the cylinder relative to the specified size. (e.g. try to approximate an O'Neill cylinder) I love generative AI models, but they're really bad at that, and this one is no exception, but the speed makes playing around with prompt variations to try to see if I get somewhere a lot easier (I'm not getting anywhere...)
- James_K 2y agoCareful how much you say that. I'm sure there's more than a few AI engineers willing to use some 3d graphics program to add a hundred thousand views of the inside of randomly generated shapes to the training set.
- test6554 2y ago"I will make it legal"
- numpad0 2y agoThat's okay. People will come up with new edge cases and keep hallucinating reasons why AI training is unethical, until the results would be up to their quality standards.
- vidarh 2y agoHey, if they want to special case on my pet test case, then awesome. I'd like to be able to use them for this.
- jonplackett 2y agoI have a favourite test for LLMs that is also still surprisingly not passed by many: You walk up to a glass door. It has 'push' written on it in mirror writing. What should you do and why. Very few can get it right, even fewer can get it right and explain the right reason. They’ll start going on about how mirror writing is secret writing and push written backwards is code for pull, rather than just that it’s a message for the person on the other side. No version of Gemini has ever passed.
- ericra 2y agoI wasn't able to get many decent results after playing with the demo for some time. I guess my question is...what exactly is this for? I was able to get substantially better results about 2 years ago running SD 2 locally on a gaming laptop. Sure, the images took 30 seconds or so each, but the quality was better than I could get in the demo. Not sure what the point of instantly generating a ton of bad quality images is. What am I missing?
- smusamashah 2y agoStream Diffusion already exists and gives you images as you type. Worked fine on RTX 3080
- wruza 2y agoIsn’t this a year old news? It was called LCM/Turbo in SD and it generated absolute crap most of the times, just like this one. Which is likely yet another “ground-breaking” finetune of SD.
- gloosx 2y agocreation... wow, they really love themselves by choosing that vocabulary; to create is divine, and this AI model is merely generating.
- musicale 2y ago> Surrey announces world's first AI model for near-instant image creation on consumer-grade hardware Kind of like what you can do on an iPhone?