10 ms·
Qwen-Image: Crafting with native text rendering
https://huggingface.co/Qwen/Qwen-Image https://huggingface.co/Qwen/Qwen-Image
https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen-Image/Qwen_Image.pdf https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen-Image/Q...
- djoldman 1y agoCheckout section 3.2 Data Filtering: https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen-Image/Qwen_Image.pdf https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen-Image/Q...
- nickandbro 1y agoThe fact that it doesn’t change the images like 4o image gen is incredible. Often when I try to tweak someone’s clothing using 4o, it also tweaks their face. This only seems to apply those recognizable AI artifacts to only the elements needing to be edited.
- herval 1y agoYou can select the area you want edited on 4o, and it’ll keep the rest unchanged
- barefootford 1y agogpt doesn't respect masks
- icelancer 1y agoCorrect. Have tried this without much success despite OpenAI's claims.
- vunderba 1y agoThat's why Flux Kontext was such a huge deal - it gave you the power of img2img inpainting without needing to manually mask the content. https://mordenstar.com/blog/edits-with-kontext https://mordenstar.com/blog/edits-with-kontext
- artninja1988 1y agoInsane how many good Chinese open source models they've been releasing. This really gives me hope
- owebmaster 1y agoI have the impression this might be a strategy to help boost the AI bubble. Big tech capex rn is too big to fail
- tokioyoyo 1y agoTaking a concrete lead in LLM-world would be a big national win for China.
- anon191928 1y agoIt will take years for people to use these but Adobe is not alone.
- herval 1y agoAdobe has never been alone. Photoshop’s AI stuff is consistently behind OSS models and workflows. It’s just way more convenient
- dvt 1y agoI think Adobe is also very careful with copyrighted content not being a part of their models, which inherently makes them of lower quality.
- herval 1y agoThey have a much better and cleaner dataset than Stable Diffusion & others, so I’d expect it to be better with some kinds of images (photos in particular)
- doctorpangloss 1y agoas long as you don't consider the part of the model which understands text as part of the model, and as long as you don't consider copyrighted text content copyrighted :)
- yjftsjthsd-h 1y agoWow, the text/writing is amazing! Also the editing in general, but the text really stands out
- rushingcreek 1y agoNot sure why this isn’t a bigger deal —- it seems like this is the first open-source model to beat gpt-image-1 in all respects while also beating Flux Kontext in terms of editing ability. This seems huge.
- zamadatix 1y agoIt's only been a few hours and the demo is constantly erroring out, people need more time to actually play with it before getting excited. Some quantized GGUFs + various comfy workflows will also likely be a big factor for this one since people will want to run it locally but it's pretty large compared to other models. Funnily enough, the main comparison to draw might be between Alibaba and Alibaba. I.e. using Wan 2.2 for image generation has been an extremely popular choice, so most will want to know how big a leap Qwen-Image is from that rather than Flux. The best time to judge how good a new image model actually is seems to be about a week from launch. That's when enough pieces have fallen into place that people have had a chance to really mess with it and come out with 3rd party pros/cons of the models. Looking hopeful for this one though!
- rushingcreek 1y agoI spun up an H100 on Voltage Park to give it a try in an isolated environment. It's really, really good. The only area where it seems less strong than gpt-image-1 is in generating images of UI (e.g. make me a landing page for Product Hunt in the style of Studio Ghibli), but other than that, I am impressed.
- hleszek 1y agoIt's not clear from their page but the editing model is not released yet: https://github.com/QwenLM/Qwen-Image/issues/3#issuecomment-3151573614 https://github.com/QwenLM/Qwen-Image/issues/3#issuecomment-3...
- tetraodonpuffer 1y agoI think the fact that, as far as I understand, it takes 40GB of VRAM to run, is probably dampening some of the enthusiasm. As an aside, I am not sure why for LLM models the technology to spread among multiple cards is quite mature, while for image models, despite also using GGUFs, this has not been the case. Maybe as image models become bigger there will be more of a push to implement it.
- rwmj 1y agoThis may be obvious to people who do this regularly, but what kind of machine is required to run this? I downloaded & tried it on my Linux machine that has a 16GB GPU and 64GB of RAM. This machine can run SD easily. But Qwen-image ran out of space both when I tried it on the GPU and on the CPU, so that's obviously not enough. But am I off by a factor of two? An order of magnitude? Do I need some crazy hardware?
- zippothrowaway 1y agoYou're probably going to have to wait a couple of days for 4 bit quantized versions to pop up. It's 20B parameters.
- pollinations 1y ago# Configure NF4 quantization quant_config = PipelineQuantizationConfig( quant_backend="bitsandbytes_4bit", quant_kwargs={"load_in_4bit": True, "bnb_4bit_quant_type": "nf4", "bnb_4bit_compute_dtype": torch.bfloat16}, components_to_quantize=["transformer", "text_encoder"], ) # Load the pipeline with NF4 quantization pipe = DiffusionPipeline.from_pretrained( model_name, quantization_config=quant_config, torch_dtype=torch.bfloat16, use_safetensors=True, low_cpu_mem_usage=True ).to(device) seems to use 17gb of vram like this update: doesn't work well. this approach seems to be recommended: https://github.com/QwenLM/Qwen-Image/pull/6/files https://github.com/QwenLM/Qwen-Image/pull/6/files
- mortsnort 1y agoI believe it's roughly the same size as the model files. If you look in the transformers folder you can see there are around 9 5gb files, so I would expect you need ~45gb vram on your GPU. Usually quantized versions of models are eventually released/created that can run on much less vram but with some quality loss.
- foobarqux 1y agoWhy doesn't huggingface list the aggregate model size?
- oceanplexian 1y agoDoes anyone know how they actually trained text rendering into these models? To me they all seem to suffer from the same artifacts, that the text looks sort of unnatural and doesn't have the correct shadows/reflections as the rest of the image. This applies to all the models I have tried, from OpenAI to Flux. Presumably they are all using the same trick?
- yorwba 1y agoIt's on page 14 of the technical report. They generate synthetic data by putting text on top of an image, apparently without taking the original lighting into account. So that's the look the model reproduces. Garbage in, garbage out. Maybe in the future someone will come up with a method for putting realistic text into images so that they can generate data to train a model for putting realistic text into images.
- doctorpangloss 1y agoi'm not sure if that's such garbage as you suggest, surely it is helpful for generalization yes? kind of the point of self-supervised models
- halJordan 1y agoIf you think diffusing legible, precise text from pure noise is garbage then wtf are you doing here. The arrogance of the it crowd can be staggering at times
- bavell 1y agoThey're referring to the training data being garbage, not the diffusion process.
- Maken 1y agoWouldn't it make sense to use rendered images for that?
- sampton 1y agoShort canva.
- esafak 1y agoTeam Qwen: Please stop ripping off Studio Ghibli to demo your product.
- gilgoomesh 1y agoThat entire banner is pure copyright infringement.
- Destiner 1y agoThe text rendering is impressive, but I don't understand the value — wouldn't it be easier to add any text that you like in Figma?
- doctorpangloss 1y agothe value is: the absence of text where you expect it, and the presence of garbled text, are dead giveaways of AI generation. i'm not sure why you are being downvoted, compositing text seems like a legitimate alternative.
- sipjca 1y agoit seems like the value is that you don't need another tool to composite the text. especially for users who aren't aware of figma/photoshop nor how to use them (many many many people)
- fc417fc802 1y agoAnd if you want the text to faithfully follow the surface of the object (ex tattoos) I don't think the post AI gen manual editing approach is going to be so straightforward.
- askl 1y agoIf you mass-publish chatgpt generated books on amazon it might be pretty useful.
- Uehreka 1y agoI’m interested to see what this model can do, but also kinda annoyed at the use of a Studio Ghibli style image as one of the first examples. Miyazaki has said over and over that he hates AI image generation. Is it really so much to ask that people not deliberately train LoRAs and finetunes specifically on his work and use them in official documentation? It reminds me of how CivitAI is full of “sexy Emma Watson” LoRAs, presumably because she very notably has said she doesn’t want to be portrayed in ways that objectify her body. There’s a really rotten vein of “anti-consent” pulsing through this community, where people deliberately seek out people who have asked to be left out of this and go “Oh yeah? Well there’s nothing you can do to stop us, here’s several terabytes of exactly what you didn’t want to happen”.
- aabhay 1y agoSeems a bit drastic to compare Ghibli style transfer to revenge porn, but you do you I guess.
- Uehreka 1y agoIt’s the anti-consent thing that ties them together. The idea of “You asked us to leave you alone, which is why we’re targeting you.”
- littlestymaar 1y agoWhy are you talking about revenge porn here?
- topato 1y agoI mean, did you really expect anything more from the internet? Maybe I'm wrong, but hentai, erotic roleplay, and nudify applications seem to still represent a massive portion of AI use cases. At least in the case of ero RP, perhaps the exploitation of people for pornography might be lessened....
- cindyllm 1y ago[dead]
- artninja1988 1y agoHow censored is it?
- Zopieux 1y agoI love that this is the only thing the community wants to know at every announce of a new model, but no organization wants to face the crude reality of human nature. That, and the weird prudishness of most american people and companies.
- balivandi 1y agoMy wife and I started a children’s jewelry business, and I’ve wanted to use AI to show children wearing our jewelry. Every time I try, I get either ridiculous results or hit some artificial censorship wall about making images with children. I would really like to find a way to do this (either online or locally) if anyone has any tips for giving a model some images of real jewelry with dimensions (and if needed even photographed or generated children) and having the model accurately place the jewelry on the kids.
- pyth0 1y agoIf you have the jewelry and the children, why do you not just take a real photo?
- balivandi 1y agoBecause it is extremely time consuming (and expensive) to do that. The logistics are very challenging with finding a variety of child models, environments/studio, outfits, lighting, cameras, photo processing, etc... And then you have to do it all over again every few months as the products and the seasons change!
- yh26yh 1y ago[flagged]
- vunderba 1y agoGood release! I've added it to the GenAI Showdown site. Overall a pretty good model scoring around 40% - and definitely represents SOTA for something that could be reasonably hosted on consumer GPU hardware (even more so when its quantized). That being said, it still lags pretty far behind OpenAI's gpt-image-1 strictly in terms of prompt adherence for txt2img prompting. However as has already been mentioned elsewhere in the thread, this model can do a lot more around editing, etc. https://genai-showdown.specr.net https://genai-showdown.specr.net
- cubefox 1y agoSide remark: I don't think it's appropriate to mix Imagen 3 and 4. Those are two different models.
- vunderba 1y agoEven though I didn't see a significant improvement over Imagen3 in adherence, I agree. Initially the page was just getting a bit crowded but now that I've added a "Show/Hide Models" toggle I'll go ahead and make that change.
- cubefox 1y agoYeah. There is also "Imagen 4 Ultra" (costs 50% more in the Gemini API), though I don't know whether it makes a significant difference.
- masfuerte 1y ago> In this case, the paper is less than one-tenth of the entire image, and the paragraph of text is relatively long, but the model still accurately generates the text on the paper. Nope. The text includes the line "That dawn will bloom" but the render reads "That down will bloom", which is meaningless.
- sciencesama 1y agoWhat lowest graphic card can support this self hosted with a reasonable output !
- deleted 1y ago[deleted]
- BoredPositron 1y agoProbably a 4080 when the nunchaku quants drop.
- blacktechnology 1y agois it an official site? https://qwen-image.ai https://qwen-image.ai
- b-lee 1y agoJust go to chat.qwen.ai and click on "Image Generation" below the text input.
- cadamsdotcom 1y agoA beast. Supposedly beats GPT-4o in image generation and Flux Kontext in image editing. If it’s as good as they say, one less reason for that ChatGPT sub..
- wg0 1y agoJaw dropping. Because text rendering isn't easy even with regular programming SDKs etc. Anyone thinking otherwise hasn't attempted implementing it or haven't thought about it in depth.
- metadat 1y agoI just tested it out, very impressive results. I wonder what the Queen team did behind the scenes to make this work so well. https://chat.qwen.ai/ https://chat.qwen.ai/ (Select "Image Generation" and be sure to use the Qwen3-235B model - also tried selecting "Coder" but it errors out.)
- android521 1y agoNone of the image model could handle showing time like generate a clock showing 3:15 pm.
- metadat 1y agoYeah, clock times are a notorious challenge for LLMs due to training data almost always showing aesthetically appealing times like 10-and-2. An entire thread on this subject previously unfolded on HN but I can't find it at this time!
- james_a_craig 1y agoIn their own first example of English text rendering, it's mistakenly rendered "The silent patient" as "The silent Patient", "The night circus" as "The night Circus", and miskerned "When stars are scattered" as "When stars are sca t t e r e d". The example further down has "down" not "dawn" in the poem. For these to be their hero image examples, they're fairly poor; I know it's a significant improvement vs. many of the other current offerings, but it's clear the bar is still being set very low.
- sixhobbits 1y agoGiven that it was literally a few months ago when these models could barely do text at all, it seems like the bar just gets higher with each advancement, no matter how impressive.
- animal531 1y agoFor my first attempt I plugged in text and a description of a small new Unity package I'm working on, and it matched the intent/text extremely well. There were a few small text mistakes and the image isn't quite as good as I've seen before, but overall it delivers on its promise.
- pradn 1y agoA silly question: do any of these models generate pixels and also vector overlays? I don't see why we need to solve the text problem pixel-for-pixel if we can just generate higher-level descriptions of the text (text, font, font size, etc). Ofc, it won't work in all situations, but it will result in high fidelity for common business cases (flyers, websites, brochures, etc).
- fahhem 1y agoStill waiting for a model that generates 2D/3D environments to get rendered by tools like Blender
- doubtfuluser 1y agoCan it generate images of a lone person standing in front of a column of tanks on Tiananmen Square?
- doubtfuluser 1y agoI’m seriously getting worried that we use models without openly discussing any potential shortcomings they have. We should somewhere have a list of models and their issues.
- qingcharles 1y agoIt told me "Content Security Warning: The input text data may contain inappropriate content."
- yh26yh 1y agovery interesting. people here talk a lot about censorship. However, I just reply sth with AIPAC, and my reply has been deleted. lol
- qingcharles 1y agoPelican riding a bicycle image came out really nicely: (it added the text) https://cdn.qwenlm.ai/output/wV13g6892e758082439d7000d439ed51a/t2i/a71fef8b-0e1e-4fdb-8397-92ba7fa21031/1754459864.png?key=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJyZXNvdXJjZV91c2VyX2lkIjoid1YxM2c2ODkyZTc1ODA4MjQzOWQ3MDAwZDQzOWVkNTFhIiwicmVzb3VyY2VfaWQiOiIxNzU0NDU5ODY0IiwicmVzb3VyY2VfY2hhdF9pZCI6IjQ2YWYwNTUzLTNkN2QtNDhhZS1iMTBkLWM1NGIxMjc5NWEwMSJ9.iQqQPmsiaNU7KygLF4RFHAlkcbgRUHGJgU8i53G6Hc0 https://cdn.qwenlm.ai/output/wV13g6892e758082439d7000d439ed5...
- laiwuchiyuan 1y ago“Qwen‑Image: Open‑source 20 B MMDiT model with stunning text rendering and image editing. Effortlessly create bilingual posters, infographics, slides, infill edits, comics.” Go experience AI: https://www.qwenimagen.com/ https://www.qwenimagen.com/ Why it works: Highlights open‑source nature and 20 billion‑parameter strength Emphasizes its superior multilingual, layout‑aware text rendering Mentions real‑world use cases: posters, slides, graphics, image editing, comics/info visuals