4 ms·

What's the best Apache or MIT-licensed python library for Diffusion Transformers?

• reasonableklout 2y ago
  HuggingFace Diffusers is Apache and supports Diffusion Transformers: https://huggingface.co/docs/diffusers/en/api/pipelines/dit https://huggingface.co/docs/diffusers/en/api/pipelines/dit
  • ilaksh 2y ago
    They are actually based on the Attribution - Non-commercial Facebook code and have the same license.
    • simonw 2y ago
      Are you sure about that? https://github.com/huggingface/diffusers https://github.com/huggingface/diffusers lists the Apache 2 license.
      • ilaksh 2y ago
        https://github.com/huggingface/diffusers/blob/v0.27.2/src/diffusers/pipelines/dit/pipeline_dit.py#L31 https://github.com/huggingface/diffusers/blob/v0.27.2/src/di...
        • bitvoid 2y ago
          That's sort of confusing (to me at least) because that particular header also lists MIT and Apache licenses.
        • mrbungie 2y ago
          Pretty sure that license header ended up in the codebase from a clever guy making a PR or it was just a mistake.
          • ilaksh 2y ago
            Ok, I would like to believe that. That's great then thanks.
            • mrbungie 2y ago
              If it worries you, maybe open an issue? No sane man would allow a weird license that's an API call away from screwing up your own products.
              • reasonableklout 2y ago
                I opened an issue here: https://github.com/huggingface/diffusers/issues/8306 https://github.com/huggingface/diffusers/issues/8306
          • pama 2y ago
            Unfortunately this statement would not offer sufficient legal protection, so the original authors would have to be convinced to give up their previous rights and change the upstream copyright (and huggingface should update their repo license statement). Of course, these days it is typically easy enough to reimplement the code from a paper in plain pytorch, so I’m not sure one needs all this huggingface repo with the extra framework and risk, but to me it doesnt fit the requirement of the OP question.
• eli_gottlieb 2y ago
  Besides huggingface there's also the DDPT repo: https://github.com/lucidrains/denoising-diffusion-pytorch/ https://github.com/lucidrains/denoising-diffusion-pytorch/
  • ilaksh 2y ago
    Nice. But is that a diffusion transformer?
    • deleted 2y ago
      [deleted]
    • eli_gottlieb 2y ago
      I believe it's got one, yes: https://github.com/lucidrains/denoising-diffusion-pytorch/blob/22f719326ed95806bb7c5a1881fe0d1557ff7d35/denoising_diffusion_pytorch/simple_diffusion.py#L308 https://github.com/lucidrains/denoising-diffusion-pytorch/bl...
• ilaksh 2y ago
  I found this: https://paperswithcode.com/paper/scalable-diffusion-models-with-transformers https://paperswithcode.com/paper/scalable-diffusion-models-w... https://github.com/mindspore-lab/mindone/tree/master/examples/dit https://github.com/mindspore-lab/mindone/tree/master/example...