23 ms·

Show HN: AI magics meet Infinite draw board

200 points by carefree0910 4y ago

I have been dreaming of creating things (arts, games, etc.), but that wouldn't be possible because I can hardly draw anything. But now with Stable Diffusion everything is hopeful again, so I further collected the AI magics that I considered necessary in creation activities, and integrated them into an Infinite draw board (like Figma). Hope that I can hear from you, any advice or suggestions will be really appreciated!

deleted 4y ago
[deleted]
cube2222 4y ago
This looks very nice! However, I'm worried that a big part of these AI tools built around SD are being posted on GitHub, marketed as open source, accept contributions, but don't have any license.
- thih9 4y ago
  > If you find software that doesn’t have a license, that generally means you have no permission from the creators of the software to use, modify, or share the software. Although a code host such as GitHub may allow you to view and fork the code, this does not imply that you are permitted to use, modify, or share the software for any purpose. Source: https://choosealicense.com/no-permission/ https://choosealicense.com/no-permission/
  - cube2222 4y ago
    Additionally, if you accept a contribution to your repo that doesn't have a license, you as the owner of the repo actually have no right to the contributed code. This also means that technically speaking, you can't add the license after the fact without contacting (and getting the agreement of) all contributors that have ever contributed to your repo.
- carefree0910 4y ago
  Oops, I thought I've used the MIT License, but it turns out that I have not! I'm also curious whether I should somehow follow the SD license... But I'm not actually using their codes though... Any advice will be really appreciated!
  - cube2222 4y ago
    IANAL but the SD license is for the model weights and using them. As long as you're not redistributing the weights, I think you're good to use the MIT license. Thanks for adding the license, very appreciated! This makes me want to take it for a spin much more!
    - carefree0910 4y ago
      Thank you so much for pointing out the missing-LICENSE-issue as well, that's really a huge miss from me XD.
- sophrocyne 4y ago
  Invoke, shared a few weeks ago, uses MIT and adheres to best practices in respecting model licenses/requirements (e.g., agreeing to not use it for hate speech, harming others, etc.) Automatic on the other hand, seems actively opposed to responding to the calls (cries?) for him to clarify a license for the repo. Closed without being addressed - https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/24 https://github.com/AUTOMATIC1111/stable-diffusion-webui/issu... 21 days open without response - https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/2059 https://github.com/AUTOMATIC1111/stable-diffusion-webui/issu... We definitely need more projects who are completely open source (both WebUI and backend) to contribute to the ecosystem, and do so responsibly, adhering to lawful and ethical usage of the work of others.
  - carefree0910 4y ago
    I noticed that they added a `LICENSE-ModelWeights.txt`! Maybe I should dive into their repo deeper and follow their good practices. Thanks a lot for the advice! It really helps!
  - RobotToaster 4y ago
    My understanding is the "ethical requirements" of the model licence preclude it from being used in any completely FOSS software, as it would violate freedom 0 by restricting the purposes someone can use the software for.
  - Kiro 4y ago
    If he doesn't want to add a license he shouldn't be bullied into adding one.
    - tough 4y ago
      But then how will big corps be able to steal his free code without any legal repercussions? </s>
- deleted 4y ago
  [deleted]
- kmeisthax 4y ago
  Wait 'till you find out how they get their training data :P The AI world does not seem to give a toss about licensing. I admire the spirit of "make stuff first, worry about copyright later", but you at least have to pay lip service to the system if you don't want to get roadkilled when "later" comes too quick. If you're on GitHub there is a fallback license in the TOS that covers forking and PRs, but you have nothing to protect you if you go off-site for whatever reason. It's there mainly to keep their users from getting sued for just being on GitHub. I don't remember how it interacts with multiple collaborating users all under the same fallback license; you may be able to argue implied license in that case, but implied license is even narrower than the GitHub fallback license.
dbieber 4y ago
Would love to see some of the things you've drawn using this tool!
- carefree0910 4y ago
  Of course! But I'm new to HN so I actually don't see any way to post images XD. I'm also concerned that posting links of my creations will be some sort of spam... Any advice will be really appreciated!
  - mhb 4y ago
    What does "XD" mean?
    - codefreakxff 4y ago
      It is a text based laughing emoji
      - jagged-chisel 4y ago
        Oh the days when “emoticons” were cool
        shrimp_emoji 4y ago
        uwu
cactusplant7374 4y ago
This could benefit from a Runpod template. Anything that makes access to high powered GPU’s easier is a win.
- carefree0910 4y ago
  Yes indeed! In fact, I've already created a Google Colab based server: https://colab.research.google.com/github/carefree0910/carefree-creator/blob/dev/tests/server.ipynb https://colab.research.google.com/github/carefree0910/carefr... Which means you can use the Google Colab as the product's backend, so you can enjoy all the AI magics for free forever XD.
googlryas 4y ago
The only reason you can't draw is because you haven't practiced(assuming you're not severely disabled). Why not work a little bit for your dreams?
- ImprobableTruth 4y ago
  Where "work a little bit" of course means thousands of hours among several years.
  - Xelynega 4y ago
    Or paying someone who put in the thousand of hours among several years instead of getting a mashup of their art out of a statistical model.
  - googlryas 4y ago
    If you only consider being a commercial artist as success, then sure. I started drawing 5 years ago(in my 30s) and have been making steady progress. I consider that a success. And I could barely draw a stick figure when I started.
- carefree0910 4y ago
  In fact, I've tried! I bought many books and just cannot get myself better at drawing... I think you've mentioned something important: I haven't got enough time practicing. Maybe when I have more free time, I'll try to pick up these skills XD!
  - _448 4y ago
    > just cannot get myself better at drawing... There is no such thing as "better" drawing. Drawing cannot be categorised as "better" or "worse". Just have a look at paintings of some of the well-known artists, example Picasso, and you will know what I mean.
    - carefree0910 4y ago
vongomben 4y ago
Wonderful project! How do I create an account for your cloud server? My phone is not accepted (maybe the hn hug of death?)
- carefree0910 4y ago
  Oops, that's in fact a bug from my side, I'm afraid it's currently only available on PC... I'll try to fix it ASAP! (p.s. I personally recommend using this project on PC, because the features on the mobile site are very, very limited XD)
- carefree0910 4y ago
  And BTW, you don't need an account to use this project if I fixed the bug / you visit it on PC!
permanent 4y ago
Yes please open source the webui codes! > *: The WebUI codes are not open sourced yet, but we are happy to open source them if it is truely helpful .
- carefree0910 4y ago
  That's exactly what I'm always looking for! Here's the related GitHub issue: https://github.com/carefree0910/carefree-creator/issues/2 https://github.com/carefree0910/carefree-creator/issues/2 Apart from the technical concerns (huge code base, lack of documentation, etc.), I'm also pretty afraid of someone (or some company) just taking away the codes and make profits or even claim that they make it, because webui codes (especially as production ready as this project) are something that's easy to copy and HARD to protect... But if more and more people get to know this project, this concern will no longer exist, and I'll definitely open source the webui codes XD! After all, I do want more and more people to be able to enjoy the current AI magics, for free, and forever!
  - zacmps 4y ago
    It won't stop everyone, but if you license it under AGPL they'd be required to share any modifications they make under the same, open, license.
    - blagie 4y ago
      <== This is the answer. The MIT license is wrong for this, as is proprietary. You want AGPL.
  - bredren 4y ago
    I don’t know how it is viewed here, but have a look at the licensing scheme adopted by Sentry.io. They faced a similar concern when people were selling the exact same product using a new name. > For example, this past year, we’ve had to deal with funded businesses plagiarizing or copying our work to directly compete with Sentry. This has included taking marketing content from our website, plagiarizing our documentation and framing it as their own, or straight-up copy/pasting our product visuals. Their defense? “Well, it’s free open-source, and we can do that.” These businesses are not using Sentry to improve how they develop software; they’re lifting its code and assets to build their closed-source products to compete directly with us. https://blog.sentry.io/2019/11/06/relicensing-sentry/ https://blog.sentry.io/2019/11/06/relicensing-sentry/
WhitneyLand 4y ago
“AI magics meet Infinite draw board” No! Your project is much cooler than the title suggests. It’s like, some kind of AI art studio app that goes beyond just text prompts. It’s a natural seeming evolution towards using generative tech in more of an iterative / workflow way. Great work.
- la64710 4y ago
  Totally absolutely amazing
- carefree0910 4y ago
  Wow, I'm so glad that you like it so much! Just as you said, I'm trying to make it a studio-ish product which combines various AI magics, so they can work together and create something that a single AI model can hardly achieve. Here's my future plan: I'm going to integrate natural language generation, music generation, video generation... Into this project, so you can make something really cool with and only with AI! And the most important part: it will always be completely open source and free, and (maybe) a Google Colab is enough to serve all these stuffs XD.
  - blagie 4y ago
    I'll make a suggestion before you go too deep: Integrate coding. I have a hundred ideas of things I'd like to build with SD for cool drawing. There's a mile-long gap between doing things in Python and in GUIs. I'd like that to be an inch-long gap. For example: - If I can use these tools in Python code (outside of your system, as a documented library), that's awesome - If I can build plug-ins into your system, that's awesome ... and so on. Photoshop, and later gimp, sort-of did this with filters, and it was an amazing boost to both. What I'd really like is something like OpenProcessing meets carefree-creator, where I can easily do creative coding. I have a neat model for how to use SD for rather creative, iterative artwork which I've wanted to hack, and I'd like a framework to hack it in.
    - carefree0910 4y ago
      That's a ton of great suggestions! I'll try to digest them and use them to guide my future works! And for your requirement, actually carefree-creator is built to be a stand-alone backend server, so you can indeed customize your own frontend if you like, as I mentioned here (the first point): https://github.com/carefree0910/carefree-creator/issues/11#issuecomment-1296381890 https://github.com/carefree0910/carefree-creator/issues/11#i... And if you are interested in customizing carefree-creator itself (like integrating your fancy model into it), I haven't written any documentation yet, but here are some brief guides: https://github.com/carefree0910/carefree-creator/issues/8#issuecomment-1296329886 https://github.com/carefree0910/carefree-creator/issues/8#is... Feel free to contact me if you encountered any trouble!
jjcm 4y ago
img2img seems to be broken for me, as it's just generating things entirely based on the prompt. Examples here: https://i.imgur.com/bEn94Zg.png https://i.imgur.com/bEn94Zg.png
- carefree0910 4y ago
  Oh, that looks like a bug... Could you please share the `fidelity` property of your `img2img` process, or share the `AI Parameters` on the right (after you select the generated image) (there should be a little `copy` icon) here? Thanks!
29athrowaway 4y ago
Does it generate pixel art?
- carefree0910 4y ago
  It is not designed to generate pixel art, but you can try something like: a lovely little cat, pixel art. It will generate something weird, but (maybe) the quality of the generated image will be better with some tweaks!
minraws 4y ago
Love the idea, hope you can continue improving on the execution, I am also fairly incapable of producing good manually drawn illustrations even though I used to be a junior designer early in school. Moved away from it as coding seemed like a more natural fit for me and helped me write games and do generative art. But this really seems like something that would let me scratch my itch to produce nice illustrations, though ofc won't give the pleasure of learning that skill myself but surely stuff like this can't hurt. :3 Really cool project mate. :)
- carefree0910 4y ago
  I'm so glad that you like it! Currently the UX is not perfect, and I'll definitely try my best to improve it XD. Looking forward to your advice and feedbacks!
tfsh 4y ago
This looks really cool and I'd love to give it a go, however the installation instructions don't seem to be working for me. I've tried both the Docker and non-docker instructions. Using Docker I get an error stating "Could not find a version that satisfies the requirement onnx-simplifier>=0.4.1" (I'm running Python 3.9.6 per the installation instructions). If I manually install the dependencies I got a bunch of errors whilst executing pip install. Has anyone else experienced these errors and know how to go about resolving them? I'm on an m1 macbook.
- carefree0910 4y ago
  I haven't tested on m1 macbook yet, but the Docker solution should be OK... Here's the onnx-simplifier project: https://pypi.org/project/onnx-simplifier/ https://pypi.org/project/onnx-simplifier/, looks like it already goes to 0.4.8. I'll try to reproduce the error, before that maybe you can try the Google Colab solution: https://colab.research.google.com/github/carefree0910/carefree-creator/blob/dev/tests/server.ipynb https://colab.research.google.com/github/carefree0910/carefr...
  - tfsh 4y ago
    Thanks! I won't try the colab just yet, as I think it would be fun if I could locally run this. I'm now getting different error messages by installing cmake (brew install cmake) before the manual install - it still looks like some odd error caused by Onnx, which is also why the manual install is failing - "fatal: not a git repository (or any of the parent directories): .git" whilst installing onnx. The Docker solution failing is weird, containers are meant to be hermetic and deterministic, maybe an upstream change broke something..., but given the Docker install error messages and the fact Onnx is a large-scale project I fail to see how that's the case either. I'll continue to debug and update the top comment if I resolve it :)
    - carefree0910 4y ago
      Thank you so much for your patience! You experience will definitely help me make this project compatible to the m1 chip systems XD! And since ONNX is not a forced requirement, maybe the following guides can make things easier: 1. Install `carefree-learn` instead of `carefree-learn[cv]` 2. Install the following packages manually: ftfy regex lmdb albumentations carefree-cv > I'll consider removing the `onnx` requirements from the `cv` spec in the near future!
GaggiX 4y ago
This program should implement the runway inpainting model, it's so much better in in/outpainting than the usual "hack" as it supports them natively.
- carefree0910 4y ago
  Guess what, I'm actually using the runway inpainting model as the backend of the `Erase & Replace` feature XD!
challenger-derp 4y ago
The UI/UX is great as many commenters have pointed out. Your write-up (readme) is also excellent. Though, at the moment, your cloud server is having trouble processing requests, I got error notifications about your cloud server posting.
- carefree0910 4y ago
  Yes indeed, my poor cloud server burnt down just now... But I fixed it so it should be OK now!

200 points by carefree0910 4y ago

deleted 4y ago

[deleted]

cube2222 4y ago

This looks very nice! However, I'm worried that a big part of these AI tools built around SD are being posted on GitHub, marketed as open source, accept contributions, but don't have any license.

thih9 4y ago
> If you find software that doesn’t have a license, that generally means you have no permission from the creators of the software to use, modify, or share the software. Although a code host such as GitHub may allow you to view and fork the code, this does not imply that you are permitted to use, modify, or share the software for any purpose. Source: https://choosealicense.com/no-permission/ https://choosealicense.com/no-permission/
- cube2222 4y ago
  Additionally, if you accept a contribution to your repo that doesn't have a license, you as the owner of the repo actually have no right to the contributed code. This also means that technically speaking, you can't add the license after the fact without contacting (and getting the agreement of) all contributors that have ever contributed to your repo.
carefree0910 4y ago
Oops, I thought I've used the MIT License, but it turns out that I have not! I'm also curious whether I should somehow follow the SD license... But I'm not actually using their codes though... Any advice will be really appreciated!
- cube2222 4y ago
  IANAL but the SD license is for the model weights and using them. As long as you're not redistributing the weights, I think you're good to use the MIT license. Thanks for adding the license, very appreciated! This makes me want to take it for a spin much more!
  - carefree0910 4y ago
    Thank you so much for pointing out the missing-LICENSE-issue as well, that's really a huge miss from me XD.
sophrocyne 4y ago
Invoke, shared a few weeks ago, uses MIT and adheres to best practices in respecting model licenses/requirements (e.g., agreeing to not use it for hate speech, harming others, etc.) Automatic on the other hand, seems actively opposed to responding to the calls (cries?) for him to clarify a license for the repo. Closed without being addressed - https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/24 https://github.com/AUTOMATIC1111/stable-diffusion-webui/issu... 21 days open without response - https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/2059 https://github.com/AUTOMATIC1111/stable-diffusion-webui/issu... We definitely need more projects who are completely open source (both WebUI and backend) to contribute to the ecosystem, and do so responsibly, adhering to lawful and ethical usage of the work of others.
- carefree0910 4y ago
  I noticed that they added a `LICENSE-ModelWeights.txt`! Maybe I should dive into their repo deeper and follow their good practices. Thanks a lot for the advice! It really helps!
- RobotToaster 4y ago
  My understanding is the "ethical requirements" of the model licence preclude it from being used in any completely FOSS software, as it would violate freedom 0 by restricting the purposes someone can use the software for.
- Kiro 4y ago
  If he doesn't want to add a license he shouldn't be bullied into adding one.
  - tough 4y ago
    But then how will big corps be able to steal his free code without any legal repercussions? </s>
deleted 4y ago
[deleted]
kmeisthax 4y ago
Wait 'till you find out how they get their training data :P The AI world does not seem to give a toss about licensing. I admire the spirit of "make stuff first, worry about copyright later", but you at least have to pay lip service to the system if you don't want to get roadkilled when "later" comes too quick. If you're on GitHub there is a fallback license in the TOS that covers forking and PRs, but you have nothing to protect you if you go off-site for whatever reason. It's there mainly to keep their users from getting sued for just being on GitHub. I don't remember how it interacts with multiple collaborating users all under the same fallback license; you may be able to argue implied license in that case, but implied license is even narrower than the GitHub fallback license.

dbieber 4y ago

Would love to see some of the things you've drawn using this tool!

carefree0910 4y ago
Of course! But I'm new to HN so I actually don't see any way to post images XD. I'm also concerned that posting links of my creations will be some sort of spam... Any advice will be really appreciated!
- mhb 4y ago
  What does "XD" mean?
  - codefreakxff 4y ago
    It is a text based laughing emoji
    - jagged-chisel 4y ago
      Oh the days when “emoticons” were cool
      - shrimp_emoji 4y ago
        uwu

cactusplant7374 4y ago

This could benefit from a Runpod template. Anything that makes access to high powered GPU’s easier is a win.

carefree0910 4y ago
Yes indeed! In fact, I've already created a Google Colab based server: https://colab.research.google.com/github/carefree0910/carefree-creator/blob/dev/tests/server.ipynb https://colab.research.google.com/github/carefree0910/carefr... Which means you can use the Google Colab as the product's backend, so you can enjoy all the AI magics for free forever XD.

googlryas 4y ago

The only reason you can't draw is because you haven't practiced(assuming you're not severely disabled). Why not work a little bit for your dreams?

ImprobableTruth 4y ago
Where "work a little bit" of course means thousands of hours among several years.
- Xelynega 4y ago
  Or paying someone who put in the thousand of hours among several years instead of getting a mashup of their art out of a statistical model.
- googlryas 4y ago
  If you only consider being a commercial artist as success, then sure. I started drawing 5 years ago(in my 30s) and have been making steady progress. I consider that a success. And I could barely draw a stick figure when I started.
carefree0910 4y ago
In fact, I've tried! I bought many books and just cannot get myself better at drawing... I think you've mentioned something important: I haven't got enough time practicing. Maybe when I have more free time, I'll try to pick up these skills XD!
- _448 4y ago
  > just cannot get myself better at drawing... There is no such thing as "better" drawing. Drawing cannot be categorised as "better" or "worse". Just have a look at paintings of some of the well-known artists, example Picasso, and you will know what I mean.
  - carefree0910 4y ago

vongomben 4y ago

Wonderful project! How do I create an account for your cloud server? My phone is not accepted (maybe the hn hug of death?)

carefree0910 4y ago
Oops, that's in fact a bug from my side, I'm afraid it's currently only available on PC... I'll try to fix it ASAP! (p.s. I personally recommend using this project on PC, because the features on the mobile site are very, very limited XD)
carefree0910 4y ago
And BTW, you don't need an account to use this project if I fixed the bug / you visit it on PC!

permanent 4y ago

Yes please open source the webui codes! > *: The WebUI codes are not open sourced yet, but we are happy to open source them if it is truely helpful .

carefree0910 4y ago
That's exactly what I'm always looking for! Here's the related GitHub issue: https://github.com/carefree0910/carefree-creator/issues/2 https://github.com/carefree0910/carefree-creator/issues/2 Apart from the technical concerns (huge code base, lack of documentation, etc.), I'm also pretty afraid of someone (or some company) just taking away the codes and make profits or even claim that they make it, because webui codes (especially as production ready as this project) are something that's easy to copy and HARD to protect... But if more and more people get to know this project, this concern will no longer exist, and I'll definitely open source the webui codes XD! After all, I do want more and more people to be able to enjoy the current AI magics, for free, and forever!
- zacmps 4y ago
  It won't stop everyone, but if you license it under AGPL they'd be required to share any modifications they make under the same, open, license.
  - blagie 4y ago
    <== This is the answer. The MIT license is wrong for this, as is proprietary. You want AGPL.
- bredren 4y ago
  I don’t know how it is viewed here, but have a look at the licensing scheme adopted by Sentry.io. They faced a similar concern when people were selling the exact same product using a new name. > For example, this past year, we’ve had to deal with funded businesses plagiarizing or copying our work to directly compete with Sentry. This has included taking marketing content from our website, plagiarizing our documentation and framing it as their own, or straight-up copy/pasting our product visuals. Their defense? “Well, it’s free open-source, and we can do that.” These businesses are not using Sentry to improve how they develop software; they’re lifting its code and assets to build their closed-source products to compete directly with us. https://blog.sentry.io/2019/11/06/relicensing-sentry/ https://blog.sentry.io/2019/11/06/relicensing-sentry/

WhitneyLand 4y ago

“AI magics meet Infinite draw board” No! Your project is much cooler than the title suggests. It’s like, some kind of AI art studio app that goes beyond just text prompts. It’s a natural seeming evolution towards using generative tech in more of an iterative / workflow way. Great work.

la64710 4y ago
Totally absolutely amazing
carefree0910 4y ago
Wow, I'm so glad that you like it so much! Just as you said, I'm trying to make it a studio-ish product which combines various AI magics, so they can work together and create something that a single AI model can hardly achieve. Here's my future plan: I'm going to integrate natural language generation, music generation, video generation... Into this project, so you can make something really cool with and only with AI! And the most important part: it will always be completely open source and free, and (maybe) a Google Colab is enough to serve all these stuffs XD.
- blagie 4y ago
  I'll make a suggestion before you go too deep: Integrate coding. I have a hundred ideas of things I'd like to build with SD for cool drawing. There's a mile-long gap between doing things in Python and in GUIs. I'd like that to be an inch-long gap. For example: - If I can use these tools in Python code (outside of your system, as a documented library), that's awesome - If I can build plug-ins into your system, that's awesome ... and so on. Photoshop, and later gimp, sort-of did this with filters, and it was an amazing boost to both. What I'd really like is something like OpenProcessing meets carefree-creator, where I can easily do creative coding. I have a neat model for how to use SD for rather creative, iterative artwork which I've wanted to hack, and I'd like a framework to hack it in.
  - carefree0910 4y ago
    That's a ton of great suggestions! I'll try to digest them and use them to guide my future works! And for your requirement, actually carefree-creator is built to be a stand-alone backend server, so you can indeed customize your own frontend if you like, as I mentioned here (the first point): https://github.com/carefree0910/carefree-creator/issues/11#issuecomment-1296381890 https://github.com/carefree0910/carefree-creator/issues/11#i... And if you are interested in customizing carefree-creator itself (like integrating your fancy model into it), I haven't written any documentation yet, but here are some brief guides: https://github.com/carefree0910/carefree-creator/issues/8#issuecomment-1296329886 https://github.com/carefree0910/carefree-creator/issues/8#is... Feel free to contact me if you encountered any trouble!

jjcm 4y ago

img2img seems to be broken for me, as it's just generating things entirely based on the prompt. Examples here: https://i.imgur.com/bEn94Zg.png https://i.imgur.com/bEn94Zg.png

carefree0910 4y ago
Oh, that looks like a bug... Could you please share the `fidelity` property of your `img2img` process, or share the `AI Parameters` on the right (after you select the generated image) (there should be a little `copy` icon) here? Thanks!

29athrowaway 4y ago

Does it generate pixel art?

carefree0910 4y ago
It is not designed to generate pixel art, but you can try something like: a lovely little cat, pixel art. It will generate something weird, but (maybe) the quality of the generated image will be better with some tweaks!

minraws 4y ago

Love the idea, hope you can continue improving on the execution, I am also fairly incapable of producing good manually drawn illustrations even though I used to be a junior designer early in school. Moved away from it as coding seemed like a more natural fit for me and helped me write games and do generative art. But this really seems like something that would let me scratch my itch to produce nice illustrations, though ofc won't give the pleasure of learning that skill myself but surely stuff like this can't hurt. :3 Really cool project mate. :)

carefree0910 4y ago
I'm so glad that you like it! Currently the UX is not perfect, and I'll definitely try my best to improve it XD. Looking forward to your advice and feedbacks!

tfsh 4y ago

This looks really cool and I'd love to give it a go, however the installation instructions don't seem to be working for me. I've tried both the Docker and non-docker instructions. Using Docker I get an error stating "Could not find a version that satisfies the requirement onnx-simplifier>=0.4.1" (I'm running Python 3.9.6 per the installation instructions). If I manually install the dependencies I got a bunch of errors whilst executing pip install. Has anyone else experienced these errors and know how to go about resolving them? I'm on an m1 macbook.

carefree0910 4y ago
I haven't tested on m1 macbook yet, but the Docker solution should be OK... Here's the onnx-simplifier project: https://pypi.org/project/onnx-simplifier/ https://pypi.org/project/onnx-simplifier/, looks like it already goes to 0.4.8. I'll try to reproduce the error, before that maybe you can try the Google Colab solution: https://colab.research.google.com/github/carefree0910/carefree-creator/blob/dev/tests/server.ipynb https://colab.research.google.com/github/carefree0910/carefr...
- tfsh 4y ago
  Thanks! I won't try the colab just yet, as I think it would be fun if I could locally run this. I'm now getting different error messages by installing cmake (brew install cmake) before the manual install - it still looks like some odd error caused by Onnx, which is also why the manual install is failing - "fatal: not a git repository (or any of the parent directories): .git" whilst installing onnx. The Docker solution failing is weird, containers are meant to be hermetic and deterministic, maybe an upstream change broke something..., but given the Docker install error messages and the fact Onnx is a large-scale project I fail to see how that's the case either. I'll continue to debug and update the top comment if I resolve it :)
  - carefree0910 4y ago
    Thank you so much for your patience! You experience will definitely help me make this project compatible to the m1 chip systems XD! And since ONNX is not a forced requirement, maybe the following guides can make things easier: 1. Install `carefree-learn` instead of `carefree-learn[cv]` 2. Install the following packages manually: ftfy regex lmdb albumentations carefree-cv > I'll consider removing the `onnx` requirements from the `cv` spec in the near future!

GaggiX 4y ago

This program should implement the runway inpainting model, it's so much better in in/outpainting than the usual "hack" as it supports them natively.

carefree0910 4y ago
Guess what, I'm actually using the runway inpainting model as the backend of the `Erase & Replace` feature XD!

challenger-derp 4y ago

The UI/UX is great as many commenters have pointed out. Your write-up (readme) is also excellent. Though, at the moment, your cloud server is having trouble processing requests, I got error notifications about your cloud server posting.

carefree0910 4y ago
Yes indeed, my poor cloud server burnt down just now... But I fixed it so it should be OK now!