3 ms·

Hi HN, we're releasing weights for our latest text to image model and publishing this writeup on how we trained it in quite a bit of depth. I hope there is som

Hi HN, we're releasing weights for our latest text to image model and publishing this writeup on how we trained it in quite a bit of depth. I hope there is something in the report for everyone, we included a fair bit on the actual training and data infrastructure usually not written about much, that I think will be interesting to people here. There's more that didn't fit, happy to answer questions!

ttul 4mo ago
This is a massive technical report for an open weights image gen model. As someone who has followed this space closely, it’s really cool to read about the behind-the-scenes experimentation and effort that went into the final product. I hope you will release some of the find tuning tools so the community can experiment with them as well and really push what the model’s capable of.
- mattnewton 4mo ago
  You can find some links and details in the GitHub readme for finetuning / LoRA support. Ostiris, musubi tuner, fal and hugging face diffusers are all day-0 supported :) https://github.com/krea-ai/krea-2 https://github.com/krea-ai/krea-2 We recommend training off the undistilled, Raw checkpoint, and then applying the LoRA to the Turbo model for inference.
  - ttul 4mo ago
    It's pretty great that you are providing the undistilled model on day 0. Here's a pro-tip: With Flux.2 Klein, someone created a turbo slider LoRA - basically a diff of the turbo 9B model vs. the undistilled 9B model. What's great about this LoRA is that you can sample using a heavier weighting of the undistilled weights during early sampling steps and then finish the sampling off with mostly the distilled weights. The result is a better "finish" (taking advantage of the distilled model's refinement for image quality) without sacrificing the undistilled model's greater ability to adhere to the prompt, because the undistilled model doesn't have to devote its weights so much to looking good.
- dvrp 4mo ago
  Thanks! You should definitely check out the r/stablediffusion sub-reddit; people are going crazy over it! We also had 0-day support from people like Ostris and ComfyUI from the open source community
vunderba 4mo ago
Neat! Between Ideogram4, Flux2, Qwen-Image, ZiT, and Krea - there's been a lot of positive movement in the open-weights space. The original Flux.1 Krea is actually in my GenAI Showdown benchmark site from all the way back in July of last year (which feels like a lifetime in this space), so I’m looking forward to putting this new one through its paces.
Taek 4mo ago
What is Krea's approach to content such as pornography and gore? It's been frustrating to see all of the leading models take a very hard line on excluding vice content, even when it is perfectly legal, in the name of safety.
- kouteiheika 4mo ago
  > What is Krea's approach to content such as pornography and gore? You mean whether it's censored? Of course it is. They even say so themselves[1]: > The open source version needed to go through some alignment training so there might be some inconsistencies between closed / open version. The "alignment training" is pretty much a code word for censorship/lobotomy, because unlike the API version they can't slap on a safe/unsafe classifier on an uncensored model. Of course, just to be clear: I don't blame. If they don't do this then the next post we'd see is them being in hot water. (Remember what happened with Grok? That's what happens when you don't take a hard line here.) [1] -- https://www.reddit.com/r/StableDiffusion/comments/1udnm0a/we_are_the_team_behind_krea_2_ask_us_anything/otdhfuh/ https://www.reddit.com/r/StableDiffusion/comments/1udnm0a/we...
  - Tadpole9181 4mo ago
    > If they don't do this then the next post we'd see is them being in hot water. (Remember what happened with Grok? That's what happens when you don't take a hard line here.) I disagree. Grok is a hosted service that can use classifiers and has been personally guided by Elon Musk directly before, that was choosing to generate and distribute child porn for users. Then after getting in trouble, had the gall to continue doing it behind a paywall.
    - b112 4mo ago
      that was choosing to generate and distribute child porn for users. This is a slant, a lie of presumption and ignorance. Ignorance of what "open" means, presumption of assigning intent without validation. Some believe that lobotomizing models leads to suboptimal results overall. Some also believe that the user, not the tool is responsible. In these contexts, you'd better call a paint manufacturing company "choosing to enable child porn". I am so sick of US style politics, with its insane labelling by both parties, and their worshippers, with intent to besmirch on every breath, because someone doesn't agree with them in some narrow political context. From outside the US, most can barely tell the difference between a democrat and a republican. Both sides are slimy, smarmy, dishonest, without honour, and spew lies and bull about anyone they don't agree with. It's absolutely disgusting.

ttul 4mo ago

This is a massive technical report for an open weights image gen model. As someone who has followed this space closely, it’s really cool to read about the behind-the-scenes experimentation and effort that went into the final product. I hope you will release some of the find tuning tools so the community can experiment with them as well and really push what the model’s capable of.

mattnewton 4mo ago
You can find some links and details in the GitHub readme for finetuning / LoRA support. Ostiris, musubi tuner, fal and hugging face diffusers are all day-0 supported :) https://github.com/krea-ai/krea-2 https://github.com/krea-ai/krea-2 We recommend training off the undistilled, Raw checkpoint, and then applying the LoRA to the Turbo model for inference.
- ttul 4mo ago
  It's pretty great that you are providing the undistilled model on day 0. Here's a pro-tip: With Flux.2 Klein, someone created a turbo slider LoRA - basically a diff of the turbo 9B model vs. the undistilled 9B model. What's great about this LoRA is that you can sample using a heavier weighting of the undistilled weights during early sampling steps and then finish the sampling off with mostly the distilled weights. The result is a better "finish" (taking advantage of the distilled model's refinement for image quality) without sacrificing the undistilled model's greater ability to adhere to the prompt, because the undistilled model doesn't have to devote its weights so much to looking good.
dvrp 4mo ago
Thanks! You should definitely check out the r/stablediffusion sub-reddit; people are going crazy over it! We also had 0-day support from people like Ostris and ComfyUI from the open source community

vunderba 4mo ago

Neat! Between Ideogram4, Flux2, Qwen-Image, ZiT, and Krea - there's been a lot of positive movement in the open-weights space. The original Flux.1 Krea is actually in my GenAI Showdown benchmark site from all the way back in July of last year (which feels like a lifetime in this space), so I’m looking forward to putting this new one through its paces.

Taek 4mo ago

What is Krea's approach to content such as pornography and gore? It's been frustrating to see all of the leading models take a very hard line on excluding vice content, even when it is perfectly legal, in the name of safety.

kouteiheika 4mo ago
> What is Krea's approach to content such as pornography and gore? You mean whether it's censored? Of course it is. They even say so themselves[1]: > The open source version needed to go through some alignment training so there might be some inconsistencies between closed / open version. The "alignment training" is pretty much a code word for censorship/lobotomy, because unlike the API version they can't slap on a safe/unsafe classifier on an uncensored model. Of course, just to be clear: I don't blame. If they don't do this then the next post we'd see is them being in hot water. (Remember what happened with Grok? That's what happens when you don't take a hard line here.) [1] -- https://www.reddit.com/r/StableDiffusion/comments/1udnm0a/we_are_the_team_behind_krea_2_ask_us_anything/otdhfuh/ https://www.reddit.com/r/StableDiffusion/comments/1udnm0a/we...
- Tadpole9181 4mo ago
  > If they don't do this then the next post we'd see is them being in hot water. (Remember what happened with Grok? That's what happens when you don't take a hard line here.) I disagree. Grok is a hosted service that can use classifiers and has been personally guided by Elon Musk directly before, that was choosing to generate and distribute child porn for users. Then after getting in trouble, had the gall to continue doing it behind a paywall.
  - b112 4mo ago
    that was choosing to generate and distribute child porn for users. This is a slant, a lie of presumption and ignorance. Ignorance of what "open" means, presumption of assigning intent without validation. Some believe that lobotomizing models leads to suboptimal results overall. Some also believe that the user, not the tool is responsible. In these contexts, you'd better call a paint manufacturing company "choosing to enable child porn". I am so sick of US style politics, with its insane labelling by both parties, and their worshippers, with intent to besmirch on every breath, because someone doesn't agree with them in some narrow political context. From outside the US, most can barely tell the difference between a democrat and a republican. Both sides are slimy, smarmy, dishonest, without honour, and spew lies and bull about anyone they don't agree with. It's absolutely disgusting.