7 ms·
FLUX.1 Kontext
- SV_BubbleTime 1y agoSingle shot LORA effect if it works as they cherry pick will be a game changer for editing. As with almost any AI release though, unless it’s open weights, I don’t care. The strengths and weaknesses of these models are apparent when you run them locally.
- ttoinou 1y agoThey’re not apparent when you run them online ?
- SV_BubbleTime 1y agoNot for what these models are actually being used for.
- nullbyte 1y agoHopefully they list this on HuggingFace for the opensource community. It looks like a great model!
- fortran77 1y agoIt still has no idea what a Model F keyboard looks like. I tried prompts and editing, and got things that weren't even close.
- deleted 1y ago[deleted]
- yorwba 1y agoYou mean when you edit a picture of a Model F keyboard and tell it to use it in a scene, it still produces a different keyboard?
- refulgentis 1y agoInteresting, would you mind sharing? (imgur allows free image uploads, quick drag and drop) I do have a "works on my machine"* :) -- prompt "Model F keyboard", all settings disabled, on the smaller model, seems to have substantially more than no idea: https://imgur.com/a/32pV6Sp https://imgur.com/a/32pV6Sp (Google Images comparison included to show in-the-wild "Model F keyboard", which may differ from my/your expected distribution) * my machine, being, https://playground.bfl.ai/ https://playground.bfl.ai/ (I have no affiliation with BFL)
- jsheard 1y agoYour generated examples just look like generic modern-day mechanical keyboards, they don't have any of the Model Fs defining features.
- AStonesThrow 1y agoYour Google Images search indicates the original problem of models training on junk misinformation online. If AI scrapers are downloading every photo that's associated with "Model F Keyboard" like that, the models have no idea what is an IBM Model F, or its distinguishing characteristics, and what is some other company's, and what is misidentified. https://commons.wikimedia.org/wiki/Category:IBM_Model_F_Keyboard https://commons.wikimedia.org/wiki/Category:IBM_Model_F_Keyb... Specifying "IBM Model F keyboard" and placing it in quotation marks improves the search. But the front page of the search is tip-of-the-iceberg compared to whatever the model's scrapers ingested. Eventually you may hit trademark protections. Reproducing a brand-name keyboard may be as difficult as simulating a celebrity's likeness. I'm not even sure what my friends look like on Facebook, so it's not clear how an AI model would reproduce a brand-name keyboard design on request.
- anjneymidha 1y agoTechnical report here for those curious: https://cdn.sanity.io/files/gsvmb6gz/production/880b072208997108f87e5d2729d8a8be481310b5.pdf https://cdn.sanity.io/files/gsvmb6gz/production/880b07220899...
- liuliu 1y agoSeems implementation is straightforward (very similar to everyone else, HiDream-E1, ICEdit, DreamO etc.), the magic is on data curation (which details are lightly shared).
- krackers 1y agoI haven't been following image generation models closely, at a high level is this new Flux model still diffusion based, or have they moved to block autoregressive (possibly with diffusion for upscaling) similar to 4o?
- liuliu 1y agoDiffusion based. There is no point to move to auto-regressive if you are not also training a multimodality LLM, which these companies are not doing that.
- deleted 1y ago[deleted]
- anotherpaul 1y agoWell it's a "generative flow matching model" That's not the same as a diffusion model. Here is a post about the difference that seems right at first glance: https://diffusionflow.github.io/ https://diffusionflow.github.io/
- rvz 1y agoUnfortunately, nobody wants to read the report, but what they are really after is to download the open-weight model. So they can take it and run with it. (No contributing back either).
- amazingamazing 1y agoDon’t understand the remove from face example. Without other pictures showing the persons face, it’s just using some stereotypical image, no?
- vessenes 1y agoMm, depends on the underlying model and where it is in the pipeline; identity models are pretty sophisticated at interpolating faces from partial geometry.
- Scaevolus 1y agoThe slideshow appears to be glitched on that first example. The input image has a snowflake covering most of her face.
- whywhywhywhy 1y agoThat's the point, it can remove it.
- sharkjacobs 1y agoThere's no "truth" it's uncovering, no real face, these are all just generated images, yes.
- amazingamazing 1y agoI get that but usually you would have two inputs, the reference “true”, and the target that it to be manipulated.
- nine_k 1y agoNot necessarily. "As you may see, this is a Chinese lady. You have seen a number of Chinese ladies in your training set. Imagine the face of this lady so that it won't contradict the fragment visible on the image with the snowflake". (Damn, it's a pseudocode prompt.)
- vessenes 1y agoPretty good! I like that they are testing face and scene coherence with iterated edits -- major pain point for 4o and other models.
- ttoinou 1y agoHow knowledgable do you need to be to tweak and train this locally ? I spent two days trying to train a LoRa customization on top of Flux 1 dev on Windows with my RTX 4090 but can’t make it work and I don’t know how deep into this topic and python library I need to study. Are there scripts kiddies in this game or only experts ?
- minimaxir 1y agoThe open-source model is not released yet, but it definitely won't be any easier than training a LoRA on Flux 1 Dev.
- ttoinou 1y agoDamn, I’m just too lazy to learn skills that will be outdated in 6 months
- johnnyApplePRNG 1y ago[flagged]
- Flemlo 1y agoIt's normally easy to find it ore configured through comfyui. Sometimes behind patreon if some YouTuber
- throwaway675117 1y ago
- minimaxir 1y agoCurrently am testing this out (using the Replicate endpoint: https://replicate.com/black-forest-labs/flux-kontext-pro https://replicate.com/black-forest-labs/flux-kontext-pro). Replicate also hosts "apps" with examples using FLUX Kontext for some common use cases of image editing: https://replicate.com/flux-kontext-apps https://replicate.com/flux-kontext-apps It's pretty good: quality of the generated images is similar to that of GPT-4o image generation if you were using it for simple image-to-image generations. Generation is speedy at about ~4 seconds per generation. Prompt engineering outside of the examples used on this page is a little fussy and I suspect will evolve over time. Changing styles or specific aspects does indeed work, but the more specific you get, the more it tends to ignore the specifics.
- skipants 1y ago> Generation is speedy at about ~4 seconds per generation May I ask on which GPU & VRAM? edit: oh unless you just meant through huggingface's UI
- cuuupid 1y agoHonestly love Replicate for always being up to date. It’s amazing that not only do we live in a time of rapid AI advancement, but that every new research grade model is immediately available via API and can be used in prod, at scale, no questions asked. Something to be said about distributors like Replicate etc that are adding an exponent to the impact of these model releases
- 1y ago
- andybak 1y agoNobody tested that page on mobile.
- jnettome 1y agoI'm trying to login to evaluate this but the google auth redirects me back to localhost:3000
- vunderba 1y agoI'm debating whether to add the FLUX Kontext model to my GenAI image comparison site. The Max variant of the model definitely scores higher in prompt adherence nearly doubling Flux 1.dev score but still falling short of OpenAI's gpt-image-1 which (visual fidelity aside) is sitting at the top of the leaderboard. I liked keeping Flux 1.D around just to have a nice baseline for local GenAI capabilities. https://genai-showdown.specr.net https://genai-showdown.specr.net Incidentally, we did add the newest release of Hunyuan's Image 2.0 model but as expected of a real-time model it scores rather poorly. EDIT: In fairness to Black Forest Labs this model definitely seems to be more focused on editing capabilities to refine and iterate on existing images rather than on strict text-to-image creation.
- Klaus23 1y agoNice site! I have a suggestion for a prompt that I could never get to work properly. It's been a while since I tried it, and the models have probably improved enough that it should be possible now. A knight with a sword in hand stands with his back to us, facing down an army. He holds his shield above his head to protect himself from the rain of arrows shot by archers visible in the rear. I was surprised at how badly the models performed. It's a fairly iconic scene, and there's more than enough training data.
- lawik 1y agoMaking an accurate flail (stick - chain - ball) is a fun sport.. weird things tend to happen.
- deleted 1y ago[deleted]
- meta87 1y agoplease add! cool site thanks :)
- nopinsight 1y agoWondering if you could add “Flux 1.1 Pro Ultra” to the site? It’s supposed to be the best among the Flux family of models, and far better than Flux Dev (3rd among your current candidates) at prompt adherence. Adding it would also provide a fair assessment for a leading open source model. The site is a great idea and features very interesting prompts. :)
- vunderba 1y agoSome of these samples are rather cherry picked. Has anyone actually tried the professional headshot app of the "Kontext Apps"? https://replicate.com/flux-kontext-apps https://replicate.com/flux-kontext-apps I've thrown half a dozen pictures of myself at it and it just completely replaced me with somebody else. To be fair, the final headshot does look very professional.
- minimaxir 1y agoIs the input image aspect ratio the same as the output aspect ratio? In some testing I've noticed that there is weirdness that happens if there is a forced shift.
- doctorpangloss 1y agoNobody has solved the scientific problem of identity preservation for faces in one shot. Nobody has even solved hands.
- mac-mc 1y agoI tried a professional headshot prompt on the flux playground with a tired gym selfie and it kept it as myself, same expression, sweat, skin tone and all. It was like a background swap, then I expanded it to "make a professional headshot version of this image that would be good for social media, make the person smile, have a good pose and clothing, clean non-sweaty skin, etc" and it stayed pretty similar, except it swapped the clothing and gave me an awkward smile, which may be accurate for those kinds of things if you think about it.
- layer8 1y ago> show me a closeup of… Investigators will love this for “enhance”. ;)
- mdp2021 1y agoAt some point, "Do not let the tool invent details!" will become a shout more frequent than most expressions.
- ilaksh 1y agoAnyone have a guess as to when the open dev version gets released? More like a week or a month or two I wonder.
- mdp2021 1y agoIs input restricted to a single image? If you could use more images as input, you could do prompts like "Place the item in image A inside image B" (e.g. "put the character of image A in the scenery of image B"), etc.
- carlosdp 1y agoThere's an experimental "multi" mode you can input multiple images to
- echelon 1y agoFal has the multi image interface to test against. (Replicate might as well, I haven't checked yet.) THIS MODEL ROCKS! It's no gpt-image-1, but it's ridiculously close. There isn't going to be a moat in images or video. I was so worried Google and OpenAI would win creative forever. Not so. Anyone can build these.
- bossyTeacher 1y agoI wonder if this is using a foundation model or a fine tuned one
- fagerhult 1y agoI vibed up a little chat interface https://kontext-chat.vercel.app/ https://kontext-chat.vercel.app/
- Hard_Space 1y agoDoes not seem to want to deal with faces at all, flags everything with humans as 'sensitive' and declines.
- eamag 1y agoCan it generate chess? https://manifold.markets/Hazel/an-ai-model-will-successfully-gener?r=ZWFtYWc https://manifold.markets/Hazel/an-ai-model-will-successfully...
- zamadatix 1y agoThe focus of this model is to be able to do iterative editing and/or use other images as a source while the focus of that bet is to consistently one shot a specific image 9/10 times with the same prompt. Given the canyon between those two focuses I don't think so, but maybe if you had an inventive enough prompt?
- gravitywp 1y agoYou can try it now on https://fluxk.art https://fluxk.art.
- deleted 1y ago[deleted]
- nioleadsdotcom 1y ago[dead]
- sahil_sharma0 1y ago[dead]
- xnorswap 1y agoI tried this out and a hilarious "context-slip" happened: https://imgur.com/a/gT6iuV1 https://imgur.com/a/gT6iuV1 It generated (via a prompt) an image of a space ship landing on a remote planet. I asked an edit, "The ship itself should be more colourful and a larger part of the image". And it replaced the space-ship with a container vessel. It had the chat history, it should have understood I still wanted a space-ship, but it dropped the relevant context for what I was trying to achieve.
- gunalx 1y agoI mean ro its credit, one of the cobtainer ships seems to be flying. /s
- mickey475778 1y ago[dead]
- sujayk_33 1y agoSo here is my understanding of current native image generation scenario, I might be wrong so please correct me, I'm still learning it and I'd appreaciate the help. First time native image gen was introduced in Gemini 1.5 Flash if I'm not wrong, and then OpenAI was released for 4o which took over the internet by Ghibli Art. We have been getting good quality images from almost all image generators like Midjourney, OpenAI and other providers, but the thing that made it special was true "multimodal" nature of it. Here's what I mean When you used to ask chatgpt to create an image, it will rephrase that prompt and internally send that prompt to Dalle, similarly gemini would send it to Imagen which were diffusion models and they had little to know context in your next response about what's there in the previous image In native image generation, it understands Audio, Text and even Image tokens in the same model and need not to rely on diffusion models internally, I don't think both Openai and google has released how they've trained it but my guess is that it's partially auto-regressive and diffusion but not sure about it
- claudefocan 1y agoThis is not fully correct. The people behind flux are the authors of stable diffusion paper that dates back to 2022. Openai initially had dallee but stable diffusion was a massive improvement on dallee. Then openai inspired itself from stable diffusion for gpt image
- rmorey 1y agoI think actually 4o image generation in ChatGPT is still a tool call with a prompt to an “image_gen” tool, I don’t think the generator receives the full context of the conversation. If you do a ChatGPT data export and inspect the record of a conversation using 4o image gen, you’ll see it’s a tool call with a distinct prompt, much like it was with dalle. And if you pass an image in as context, it’ll pass that to the tool as well. I imagine this is for anti-jailbreak moderation reasons, which is understandable
- colafly 1y agois it possible to provide mask? haven't hard time changing specific area
- charlie0simmon 1y ago[dead]
- hackerwhy 1y agoDo they opensource their model structure?
- jackdawipper 1y agothey will, presumably. dev model will be a reduced version for open source.
- useapi 1y ago[dead]